dmesg - 8192 MB DDR3-1333MHz
[39897.102281] CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 0
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 46
CPU 2: hi: 186, btch: 31 usd: 28
CPU 3: hi: 186, btch: 31 usd: 54
CPU 4: hi: 186, btch: 31 usd: 38
CPU 5: hi: 186, btch: 31 usd: 94
CPU 6: hi: 186, btch: 31 usd: 98
CPU 7: hi: 186, btch: 31 usd: 78
CPU 8: hi: 186, btch: 31 usd: 125
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 72
CPU 11: hi: 186, btch: 31 usd: 12
CPU 12: hi: 186, btch: 31 usd: 61
CPU 13: hi: 186, btch: 31 usd: 55
CPU 14: hi: 186, btch: 31 usd: 45
CPU 15: hi: 186, btch: 31 usd: 1
CPU 16: hi: 186, btch: 31 usd: 25
CPU 17: hi: 186, btch: 31 usd: 32
CPU 18: hi: 186, btch: 31 usd: 1
CPU 19: hi: 186, btch: 31 usd: 44
CPU 20: hi: 186, btch: 31 usd: 147
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 4
CPU 23: hi: 186, btch: 31 usd: 9
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 6
CPU 1: hi: 186, btch: 31 usd: 0
CPU 2: hi: 186, btch: 31 usd: 1
CPU 3: hi: 186, btch: 31 usd: 29
CPU 4: hi: 186, btch: 31 usd: 17
CPU 5: hi: 186, btch: 31 usd: 0
CPU 6: hi: 186, btch: 31 usd: 31
CPU 7: hi: 186, btch: 31 usd: 174
CPU 8: hi: 186, btch: 31 usd: 73
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 35
CPU 11: hi: 186, btch: 31 usd: 40
CPU 12: hi: 186, btch: 31 usd: 14
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 0
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 5
CPU 18: hi: 186, btch: 31 usd: 5
CPU 19: hi: 186, btch: 31 usd: 2
CPU 20: hi: 186, btch: 31 usd: 35
CPU 21: hi: 186, btch: 31 usd: 30
CPU 22: hi: 186, btch: 31 usd: 1
CPU 23: hi: 186, btch: 31 usd: 43
active_anon:15141828 inactive_anon:865914 isolated_anon:0
active_file:149 inactive_file:4 isolated_file:277
unevictable:111809 dirty:0 writeback:58 unstable:0
free:42156 slab_reclaimable:5713 slab_unreclaimable:14460
mapped:6677 shmem:438 pagetables:36950 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:121828kB min:980kB low:1224kB high:1468kB active_anon:1833632kB inactive_anon:8324kB active_file:0kB inactive_file:200kB unevictable:184kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:20kB slab_reclaimable:436kB slab_unreclaimable:656kB kernel_stack:8kB pagetables:3696kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1654 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14684kB min:15260kB low:19072kB high:22888kB active_anon:28390892kB inactive_anon:1670252kB active_file:608kB inactive_file:0kB unevictable:199600kB isolated(anon):0kB isolated(file):800kB present:31027200kB mlocked:2784kB dirty:0kB writeback:68kB mapped:11796kB shmem:740kB slab_reclaimable:12384kB slab_unreclaimable:36760kB kernel_stack:10608kB pagetables:70264kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1678 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:16252kB min:16276kB low:20344kB high:24412kB active_anon:30342788kB inactive_anon:1785080kB active_file:244kB inactive_file:0kB unevictable:247452kB isolated(anon):0kB isolated(file):308kB present:33095680kB mlocked:2156kB dirty:0kB writeback:164kB mapped:14908kB shmem:992kB slab_reclaimable:10032kB slab_unreclaimable:20424kB kernel_stack:6992kB pagetables:73840kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2360 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 544*4kB 304*8kB 100*16kB 49*32kB 24*64kB 19*128kB 14*256kB 8*512kB 6*1024kB 5*2048kB 21*4096kB = 121824kB
Node 0 Normal: 690*4kB 242*8kB 92*16kB 41*32kB 9*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 2*2048kB 0*4096kB = 13944kB
Node 1 Normal: 877*4kB 208*8kB 59*16kB 68*32kB 17*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16036kB
112302 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
31208 pages shared
16465458 pages non-shared
Out of memory: kill process 1617 (rsyslogd) score 31952 or a child
Killed process 1617 (rsyslogd) vsz:255616kB, anon-rss:468kB, file-rss:588kB
rsyslogd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
rsyslogd cpuset=/ mems_allowed=0-1
Pid: 1644, comm: rsyslogd Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] ? autoremove_wake_function+0x0/0x40
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 31
CPU 1: hi: 186, btch: 31 usd: 30
CPU 2: hi: 186, btch: 31 usd: 0
CPU 3: hi: 186, btch: 31 usd: 0
CPU 4: hi: 186, btch: 31 usd: 22
CPU 5: hi: 186, btch: 31 usd: 0
CPU 6: hi: 186, btch: 31 usd: 20
CPU 7: hi: 186, btch: 31 usd: 63
CPU 8: hi: 186, btch: 31 usd: 39
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 31
CPU 11: hi: 186, btch: 31 usd: 4
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 12
CPU 14: hi: 186, btch: 31 usd: 0
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 0
CPU 18: hi: 186, btch: 31 usd: 0
CPU 19: hi: 186, btch: 31 usd: 2
CPU 20: hi: 186, btch: 31 usd: 52
CPU 21: hi: 186, btch: 31 usd: 30
CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 0
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 77
CPU 2: hi: 186, btch: 31 usd: 164
CPU 3: hi: 186, btch: 31 usd: 54
CPU 4: hi: 186, btch: 31 usd: 38
CPU 5: hi: 186, btch: 31 usd: 94
CPU 6: hi: 186, btch: 31 usd: 98
CPU 7: hi: 186, btch: 31 usd: 78
CPU 8: hi: 186, btch: 31 usd: 125
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 72
CPU 11: hi: 186, btch: 31 usd: 12
CPU 12: hi: 186, btch: 31 usd: 61
CPU 13: hi: 186, btch: 31 usd: 55
CPU 14: hi: 186, btch: 31 usd: 45
CPU 15: hi: 186, btch: 31 usd: 1
CPU 16: hi: 186, btch: 31 usd: 25
CPU 17: hi: 186, btch: 31 usd: 32
CPU 18: hi: 186, btch: 31 usd: 1
CPU 19: hi: 186, btch: 31 usd: 44
CPU 20: hi: 186, btch: 31 usd: 147
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 4
CPU 23: hi: 186, btch: 31 usd: 9
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 6
CPU 1: hi: 186, btch: 31 usd: 0
CPU 2: hi: 186, btch: 31 usd: 147
CPU 3: hi: 186, btch: 31 usd: 29
CPU 4: hi: 186, btch: 31 usd: 17
CPU 5: hi: 186, btch: 31 usd: 0
CPU 6: hi: 186, btch: 31 usd: 31
CPU 7: hi: 186, btch: 31 usd: 174
CPU 8: hi: 186, btch: 31 usd: 73
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 35
CPU 11: hi: 186, btch: 31 usd: 40
CPU 12: hi: 186, btch: 31 usd: 14
CPU 13: hi: 186, btch: 31 usd: 2
CPU 14: hi: 186, btch: 31 usd: 11
CPU 15: hi: 186, btch: 31 usd: 9
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 5
CPU 18: hi: 186, btch: 31 usd: 5
CPU 19: hi: 186, btch: 31 usd: 2
CPU 20: hi: 186, btch: 31 usd: 35
CPU 21: hi: 186, btch: 31 usd: 30
CPU 22: hi: 186, btch: 31 usd: 1
CPU 23: hi: 186, btch: 31 usd: 43
active_anon:15141766 inactive_anon:865930 isolated_anon:0
active_file:0 inactive_file:91 isolated_file:264
unevictable:111809 dirty:45 writeback:0 unstable:0
free:42097 slab_reclaimable:5694 slab_unreclaimable:14464
mapped:6611 shmem:438 pagetables:36951 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:121824kB min:980kB low:1224kB high:1468kB active_anon:1833744kB inactive_anon:8324kB active_file:0kB inactive_file:80kB unevictable:184kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:20kB slab_reclaimable:436kB slab_unreclaimable:656kB kernel_stack:8kB pagetables:3696kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1654 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14792kB min:15260kB low:19072kB high:22888kB active_anon:28390492kB inactive_anon:1670316kB active_file:0kB inactive_file:108kB unevictable:199600kB isolated(anon):0kB isolated(file):768kB present:31027200kB mlocked:2784kB dirty:108kB writeback:0kB mapped:11592kB shmem:740kB slab_reclaimable:12384kB slab_unreclaimable:36776kB kernel_stack:10608kB pagetables:70268kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:495 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15912kB min:16276kB low:20344kB high:24412kB active_anon:30342828kB inactive_anon:1785080kB active_file:0kB inactive_file:176kB unevictable:247452kB isolated(anon):0kB isolated(file):288kB present:33095680kB mlocked:2156kB dirty:72kB writeback:0kB mapped:14852kB shmem:992kB slab_reclaimable:9956kB slab_unreclaimable:20424kB kernel_stack:6992kB pagetables:73840kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2412 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 544*4kB 304*8kB 100*16kB 49*32kB 24*64kB 19*128kB 14*256kB 8*512kB 6*1024kB 5*2048kB 21*4096kB = 121824kB
Node 0 Normal: 834*4kB 256*8kB 100*16kB 43*32kB 9*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 2*2048kB 0*4096kB = 14952kB
Node 1 Normal: 876*4kB 209*8kB 51*16kB 68*32kB 17*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 15912kB
112170 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
29993 pages shared
16465240 pages non-shared
Out of memory: kill process 1984 (whoopsie) score 25268 or a child
Killed process 1984 (whoopsie) vsz:202144kB, anon-rss:1304kB, file-rss:724kB
init: rsyslog main process (1617) killed by KILL signal
init: rsyslog main process ended, respawning
ramsmp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0
ramsmp cpuset=/ mems_allowed=0-1
Pid: 44204, comm: ramsmp Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_page_vma+0x89/0x140
[] do_anonymous_page+0x160/0x350
[] ? __switch_to+0x26e/0x320
[] handle_mm_fault+0x32f/0x440
[] ? schedule+0x3e1/0x830
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 170
CPU 1: hi: 186, btch: 31 usd: 55
CPU 2: hi: 186, btch: 31 usd: 33
CPU 3: hi: 186, btch: 31 usd: 13
CPU 4: hi: 186, btch: 31 usd: 167
CPU 5: hi: 186, btch: 31 usd: 88
CPU 6: hi: 186, btch: 31 usd: 78
CPU 7: hi: 186, btch: 31 usd: 131
CPU 8: hi: 186, btch: 31 usd: 56
CPU 9: hi: 186, btch: 31 usd: 121
CPU 10: hi: 186, btch: 31 usd: 26
CPU 11: hi: 186, btch: 31 usd: 53
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 14
CPU 14: hi: 186, btch: 31 usd: 45
CPU 15: hi: 186, btch: 31 usd: 82
CPU 16: hi: 186, btch: 31 usd: 155
CPU 17: hi: 186, btch: 31 usd: 0
CPU 18: hi: 186, btch: 31 usd: 119
CPU 19: hi: 186, btch: 31 usd: 33
CPU 20: hi: 186, btch: 31 usd: 46
CPU 21: hi: 186, btch: 31 usd: 1
CPU 22: hi: 186, btch: 31 usd: 145
CPU 23: hi: 186, btch: 31 usd: 25
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 169
CPU 1: hi: 186, btch: 31 usd: 78
CPU 2: hi: 186, btch: 31 usd: 54
CPU 3: hi: 186, btch: 31 usd: 31
CPU 4: hi: 186, btch: 31 usd: 167
CPU 5: hi: 186, btch: 31 usd: 67
CPU 6: hi: 186, btch: 31 usd: 30
CPU 7: hi: 186, btch: 31 usd: 159
CPU 8: hi: 186, btch: 31 usd: 53
CPU 9: hi: 186, btch: 31 usd: 54
CPU 10: hi: 186, btch: 31 usd: 75
CPU 11: hi: 186, btch: 31 usd: 180
CPU 12: hi: 186, btch: 31 usd: 94
CPU 13: hi: 186, btch: 31 usd: 37
CPU 14: hi: 186, btch: 31 usd: 59
CPU 15: hi: 186, btch: 31 usd: 180
CPU 16: hi: 186, btch: 31 usd: 176
CPU 17: hi: 186, btch: 31 usd: 32
CPU 18: hi: 186, btch: 31 usd: 168
CPU 19: hi: 186, btch: 31 usd: 72
CPU 20: hi: 186, btch: 31 usd: 118
CPU 21: hi: 186, btch: 31 usd: 163
CPU 22: hi: 186, btch: 31 usd: 113
CPU 23: hi: 186, btch: 31 usd: 34
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 8
CPU 1: hi: 186, btch: 31 usd: 34
CPU 2: hi: 186, btch: 31 usd: 177
CPU 3: hi: 186, btch: 31 usd: 30
CPU 4: hi: 186, btch: 31 usd: 35
CPU 5: hi: 186, btch: 31 usd: 180
CPU 6: hi: 186, btch: 31 usd: 58
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 64
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 49
CPU 11: hi: 186, btch: 31 usd: 33
CPU 12: hi: 186, btch: 31 usd: 14
CPU 13: hi: 186, btch: 31 usd: 7
CPU 14: hi: 186, btch: 31 usd: 0
CPU 15: hi: 186, btch: 31 usd: 48
CPU 16: hi: 186, btch: 31 usd: 30
CPU 17: hi: 186, btch: 31 usd: 5
CPU 18: hi: 186, btch: 31 usd: 9
CPU 19: hi: 186, btch: 31 usd: 33
CPU 20: hi: 186, btch: 31 usd: 58
CPU 21: hi: 186, btch: 31 usd: 165
CPU 22: hi: 186, btch: 31 usd: 11
CPU 23: hi: 186, btch: 31 usd: 21
active_anon:15137248 inactive_anon:866583 isolated_anon:0
active_file:23 inactive_file:65 isolated_file:0
unevictable:111806 dirty:0 writeback:0 unstable:0
free:42227 slab_reclaimable:5733 slab_unreclaimable:14655
mapped:6817 shmem:438 pagetables:36673 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122176kB min:980kB low:1224kB high:1468kB active_anon:1824672kB inactive_anon:11268kB active_file:12kB inactive_file:204kB unevictable:188kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:104kB writeback:0kB mapped:356kB shmem:20kB slab_reclaimable:468kB slab_unreclaimable:716kB kernel_stack:40kB pagetables:3508kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:352 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14936kB min:15260kB low:19072kB high:22888kB active_anon:28383700kB inactive_anon:1670004kB active_file:0kB inactive_file:0kB unevictable:199596kB isolated(anon):0kB isolated(file):0kB present:31027200kB mlocked:2784kB dirty:156kB writeback:0kB mapped:12220kB shmem:740kB slab_reclaimable:12508kB slab_unreclaimable:37520kB kernel_stack:11168kB pagetables:69780kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:232 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15936kB min:16276kB low:20344kB high:24412kB active_anon:30340620kB inactive_anon:1785060kB active_file:244kB inactive_file:164kB unevictable:247440kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2156kB dirty:0kB writeback:0kB mapped:14692kB shmem:992kB slab_reclaimable:9956kB slab_unreclaimable:20384kB kernel_stack:6992kB pagetables:73404kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:766 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 274*4kB 288*8kB 166*16kB 49*32kB 23*64kB 19*128kB 14*256kB 8*512kB 6*1024kB 5*2048kB 21*4096kB = 121608kB
Node 0 Normal: 534*4kB 146*8kB 101*16kB 92*32kB 13*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 2*2048kB 0*4096kB = 14712kB
Node 1 Normal: 845*4kB 193*8kB 37*16kB 53*32kB 30*64kB 3*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 15660kB
112508 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
28336 pages shared
16462412 pages non-shared
Out of memory: kill process 2521 (nrsysmond) score 9626 or a child
Killed process 2522 (nrsysmond) vsz:106484kB, anon-rss:1100kB, file-rss:796kB
nrsysmond invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
nrsysmond cpuset=/ mems_allowed=0-1
Pid: 2521, comm: nrsysmond Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] ? delayacct_end+0x89/0xa0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] ? call_rcu+0xe/0x10
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 167
CPU 1: hi: 186, btch: 31 usd: 55
CPU 2: hi: 186, btch: 31 usd: 38
CPU 3: hi: 186, btch: 31 usd: 13
CPU 4: hi: 186, btch: 31 usd: 167
CPU 5: hi: 186, btch: 31 usd: 96
CPU 6: hi: 186, btch: 31 usd: 78
CPU 7: hi: 186, btch: 31 usd: 131
CPU 8: hi: 186, btch: 31 usd: 54
CPU 9: hi: 186, btch: 31 usd: 121
CPU 10: hi: 186, btch: 31 usd: 26
CPU 11: hi: 186, btch: 31 usd: 53
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 14
CPU 14: hi: 186, btch: 31 usd: 45
CPU 15: hi: 186, btch: 31 usd: 124
CPU 16: hi: 186, btch: 31 usd: 155
CPU 17: hi: 186, btch: 31 usd: 0
CPU 18: hi: 186, btch: 31 usd: 119
CPU 19: hi: 186, btch: 31 usd: 33
CPU 20: hi: 186, btch: 31 usd: 46
CPU 21: hi: 186, btch: 31 usd: 1
CPU 22: hi: 186, btch: 31 usd: 64
CPU 23: hi: 186, btch: 31 usd: 54
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 159
CPU 1: hi: 186, btch: 31 usd: 53
CPU 2: hi: 186, btch: 31 usd: 58
CPU 3: hi: 186, btch: 31 usd: 52
CPU 4: hi: 186, btch: 31 usd: 168
CPU 5: hi: 186, btch: 31 usd: 93
CPU 6: hi: 186, btch: 31 usd: 33
CPU 7: hi: 186, btch: 31 usd: 160
CPU 8: hi: 186, btch: 31 usd: 53
CPU 9: hi: 186, btch: 31 usd: 54
CPU 10: hi: 186, btch: 31 usd: 75
CPU 11: hi: 186, btch: 31 usd: 179
CPU 12: hi: 186, btch: 31 usd: 94
CPU 13: hi: 186, btch: 31 usd: 38
CPU 14: hi: 186, btch: 31 usd: 61
CPU 15: hi: 186, btch: 31 usd: 172
CPU 16: hi: 186, btch: 31 usd: 176
CPU 17: hi: 186, btch: 31 usd: 32
CPU 18: hi: 186, btch: 31 usd: 160
CPU 19: hi: 186, btch: 31 usd: 74
CPU 20: hi: 186, btch: 31 usd: 118
CPU 21: hi: 186, btch: 31 usd: 163
CPU 22: hi: 186, btch: 31 usd: 157
CPU 23: hi: 186, btch: 31 usd: 5
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 69
CPU 1: hi: 186, btch: 31 usd: 34
CPU 2: hi: 186, btch: 31 usd: 177
CPU 3: hi: 186, btch: 31 usd: 30
CPU 4: hi: 186, btch: 31 usd: 35
CPU 5: hi: 186, btch: 31 usd: 184
CPU 6: hi: 186, btch: 31 usd: 80
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 74
CPU 9: hi: 186, btch: 31 usd: 28
CPU 10: hi: 186, btch: 31 usd: 49
CPU 11: hi: 186, btch: 31 usd: 49
CPU 12: hi: 186, btch: 31 usd: 14
CPU 13: hi: 186, btch: 31 usd: 7
CPU 14: hi: 186, btch: 31 usd: 6
CPU 15: hi: 186, btch: 31 usd: 48
CPU 16: hi: 186, btch: 31 usd: 30
CPU 17: hi: 186, btch: 31 usd: 5
CPU 18: hi: 186, btch: 31 usd: 20
CPU 19: hi: 186, btch: 31 usd: 33
CPU 20: hi: 186, btch: 31 usd: 58
CPU 21: hi: 186, btch: 31 usd: 165
CPU 22: hi: 186, btch: 31 usd: 26
CPU 23: hi: 186, btch: 31 usd: 23
active_anon:15137361 inactive_anon:866703 isolated_anon:0
active_file:129 inactive_file:222 isolated_file:50
unevictable:111804 dirty:0 writeback:41 unstable:0
free:42145 slab_reclaimable:5681 slab_unreclaimable:14784
mapped:6707 shmem:438 pagetables:36784 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122020kB min:980kB low:1224kB high:1468kB active_anon:1823848kB inactive_anon:11908kB active_file:60kB inactive_file:0kB unevictable:184kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:56kB writeback:0kB mapped:192kB shmem:20kB slab_reclaimable:436kB slab_unreclaimable:876kB kernel_stack:96kB pagetables:3728kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:109 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:15244kB min:15260kB low:19072kB high:22888kB active_anon:28384172kB inactive_anon:1669844kB active_file:304kB inactive_file:872kB unevictable:199592kB isolated(anon):0kB isolated(file):128kB present:31027200kB mlocked:2784kB dirty:0kB writeback:316kB mapped:11960kB shmem:740kB slab_reclaimable:12336kB slab_unreclaimable:37700kB kernel_stack:11176kB pagetables:69996kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1791 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15456kB min:16276kB low:20344kB high:24412kB active_anon:30341424kB inactive_anon:1785060kB active_file:152kB inactive_file:28kB unevictable:247440kB isolated(anon):0kB isolated(file):72kB present:33095680kB mlocked:2156kB dirty:0kB writeback:0kB mapped:14676kB shmem:992kB slab_reclaimable:9952kB slab_unreclaimable:20560kB kernel_stack:6992kB pagetables:73412kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:298 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 355*4kB 289*8kB 167*16kB 49*32kB 23*64kB 19*128kB 14*256kB 8*512kB 6*1024kB 5*2048kB 21*4096kB = 121956kB
Node 0 Normal: 737*4kB 153*8kB 102*16kB 93*32kB 13*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 2*2048kB 0*4096kB = 15628kB
Node 1 Normal: 814*4kB 192*8kB 36*16kB 53*32kB 30*64kB 3*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 15512kB
112370 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
27998 pages shared
16462189 pages non-shared
Out of memory: kill process 2549 (nscd) score 5943 or a child
Killed process 2549 (nscd) vsz:760704kB, anon-rss:416kB, file-rss:568kB
ramsmp invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0
ramsmp cpuset=/ mems_allowed=0-1
Pid: 44204, comm: ramsmp Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_page_vma+0x89/0x140
[] do_anonymous_page+0x160/0x350
[] ? __switch_to+0x26e/0x320
[] handle_mm_fault+0x32f/0x440
[] ? schedule+0x3e1/0x830
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 167
CPU 1: hi: 186, btch: 31 usd: 55
CPU 2: hi: 186, btch: 31 usd: 38
CPU 3: hi: 186, btch: 31 usd: 13
CPU 4: hi: 186, btch: 31 usd: 167
CPU 5: hi: 186, btch: 31 usd: 96
CPU 6: hi: 186, btch: 31 usd: 78
CPU 7: hi: 186, btch: 31 usd: 131
CPU 8: hi: 186, btch: 31 usd: 54
CPU 9: hi: 186, btch: 31 usd: 121
CPU 10: hi: 186, btch: 31 usd: 26
CPU 11: hi: 186, btch: 31 usd: 53
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 14
CPU 14: hi: 186, btch: 31 usd: 45
CPU 15: hi: 186, btch: 31 usd: 124
CPU 16: hi: 186, btch: 31 usd: 155
CPU 17: hi: 186, btch: 31 usd: 0
CPU 18: hi: 186, btch: 31 usd: 119
CPU 19: hi: 186, btch: 31 usd: 33
CPU 20: hi: 186, btch: 31 usd: 46
CPU 21: hi: 186, btch: 31 usd: 1
CPU 22: hi: 186, btch: 31 usd: 64
CPU 23: hi: 186, btch: 31 usd: 54
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 127
CPU 1: hi: 186, btch: 31 usd: 33
CPU 2: hi: 186, btch: 31 usd: 59
CPU 3: hi: 186, btch: 31 usd: 31
CPU 4: hi: 186, btch: 31 usd: 168
CPU 5: hi: 186, btch: 31 usd: 93
CPU 6: hi: 186, btch: 31 usd: 26
CPU 7: hi: 186, btch: 31 usd: 160
CPU 8: hi: 186, btch: 31 usd: 53
CPU 9: hi: 186, btch: 31 usd: 54
CPU 10: hi: 186, btch: 31 usd: 75
CPU 11: hi: 186, btch: 31 usd: 120
CPU 12: hi: 186, btch: 31 usd: 94
CPU 13: hi: 186, btch: 31 usd: 64
CPU 14: hi: 186, btch: 31 usd: 61
CPU 15: hi: 186, btch: 31 usd: 172
CPU 16: hi: 186, btch: 31 usd: 176
CPU 17: hi: 186, btch: 31 usd: 32
CPU 18: hi: 186, btch: 31 usd: 98
CPU 19: hi: 186, btch: 31 usd: 66
CPU 20: hi: 186, btch: 31 usd: 118
CPU 21: hi: 186, btch: 31 usd: 163
CPU 22: hi: 186, btch: 31 usd: 157
CPU 23: hi: 186, btch: 31 usd: 5
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 69
CPU 1: hi: 186, btch: 31 usd: 34
CPU 2: hi: 186, btch: 31 usd: 177
CPU 3: hi: 186, btch: 31 usd: 30
CPU 4: hi: 186, btch: 31 usd: 35
CPU 5: hi: 186, btch: 31 usd: 184
CPU 6: hi: 186, btch: 31 usd: 80
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 74
CPU 9: hi: 186, btch: 31 usd: 28
CPU 10: hi: 186, btch: 31 usd: 49
CPU 11: hi: 186, btch: 31 usd: 49
CPU 12: hi: 186, btch: 31 usd: 14
CPU 13: hi: 186, btch: 31 usd: 122
CPU 14: hi: 186, btch: 31 usd: 6
CPU 15: hi: 186, btch: 31 usd: 48
CPU 16: hi: 186, btch: 31 usd: 30
CPU 17: hi: 186, btch: 31 usd: 5
CPU 18: hi: 186, btch: 31 usd: 20
CPU 19: hi: 186, btch: 31 usd: 33
CPU 20: hi: 186, btch: 31 usd: 58
CPU 21: hi: 186, btch: 31 usd: 165
CPU 22: hi: 186, btch: 31 usd: 26
CPU 23: hi: 186, btch: 31 usd: 23
active_anon:15137439 inactive_anon:866740 isolated_anon:0
active_file:152 inactive_file:166 isolated_file:52
unevictable:111809 dirty:0 writeback:0 unstable:0
free:42091 slab_reclaimable:5680 slab_unreclaimable:14757
mapped:6624 shmem:438 pagetables:36768 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:121980kB min:980kB low:1224kB high:1468kB active_anon:1823972kB inactive_anon:12036kB active_file:0kB inactive_file:20kB unevictable:188kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:56kB writeback:0kB mapped:128kB shmem:20kB slab_reclaimable:436kB slab_unreclaimable:908kB kernel_stack:96kB pagetables:3728kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:109 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14988kB min:15260kB low:19072kB high:22888kB active_anon:28384380kB inactive_anon:1670012kB active_file:504kB inactive_file:592kB unevictable:199608kB isolated(anon):0kB isolated(file):136kB present:31027200kB mlocked:2784kB dirty:44kB writeback:0kB mapped:11640kB shmem:740kB slab_reclaimable:12336kB slab_unreclaimable:37652kB kernel_stack:11176kB pagetables:69972kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1887 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15536kB min:16276kB low:20344kB high:24412kB active_anon:30341404kB inactive_anon:1784912kB active_file:128kB inactive_file:52kB unevictable:247440kB isolated(anon):0kB isolated(file):72kB present:33095680kB mlocked:2156kB dirty:0kB writeback:0kB mapped:14728kB shmem:992kB slab_reclaimable:9948kB slab_unreclaimable:20468kB kernel_stack:6992kB pagetables:73372kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:298 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 355*4kB 289*8kB 167*16kB 49*32kB 23*64kB 19*128kB 14*256kB 8*512kB 6*1024kB 5*2048kB 21*4096kB = 121956kB
Node 0 Normal: 644*4kB 153*8kB 102*16kB 93*32kB 13*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 2*2048kB 0*4096kB = 15256kB
Node 1 Normal: 814*4kB 192*8kB 36*16kB 53*32kB 30*64kB 3*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 15512kB
112344 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
27928 pages shared
16462349 pages non-shared
Out of memory: kill process 6802 (pickup) score 5329 or a child
Killed process 6802 (pickup) vsz:21316kB, anon-rss:232kB, file-rss:584kB
cron invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
cron cpuset=/ mems_allowed=0-1
Pid: 6135, comm: cron Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_page_vma+0x89/0x140
[] do_wp_page+0xe3/0x900
[] ? __do_fault+0x479/0x560
[] handle_mm_fault+0x2fc/0x440
[] ? do_mmap_pgoff+0x335/0x380
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 0
CPU 1: hi: 186, btch: 31 usd: 26
CPU 2: hi: 186, btch: 31 usd: 24
CPU 3: hi: 186, btch: 31 usd: 59
CPU 4: hi: 186, btch: 31 usd: 0
CPU 5: hi: 186, btch: 31 usd: 8
CPU 6: hi: 186, btch: 31 usd: 0
CPU 7: hi: 186, btch: 31 usd: 0
CPU 8: hi: 186, btch: 31 usd: 0
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 28
CPU 11: hi: 186, btch: 31 usd: 0
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 76
CPU 14: hi: 186, btch: 31 usd: 45
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 0
CPU 18: hi: 186, btch: 31 usd: 0
CPU 19: hi: 186, btch: 31 usd: 0
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 0
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 0
CPU 1: hi: 186, btch: 31 usd: 30
CPU 2: hi: 186, btch: 31 usd: 28
CPU 3: hi: 186, btch: 31 usd: 86
CPU 4: hi: 186, btch: 31 usd: 0
CPU 5: hi: 186, btch: 31 usd: 0
CPU 6: hi: 186, btch: 31 usd: 0
CPU 7: hi: 186, btch: 31 usd: 26
CPU 8: hi: 186, btch: 31 usd: 5
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 0
CPU 11: hi: 186, btch: 31 usd: 30
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 3
CPU 14: hi: 186, btch: 31 usd: 61
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 31
CPU 17: hi: 186, btch: 31 usd: 32
CPU 18: hi: 186, btch: 31 usd: 0
CPU 19: hi: 186, btch: 31 usd: 0
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 0
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 0
CPU 1: hi: 186, btch: 31 usd: 0
CPU 2: hi: 186, btch: 31 usd: 3
CPU 3: hi: 186, btch: 31 usd: 55
CPU 4: hi: 186, btch: 31 usd: 0
CPU 5: hi: 186, btch: 31 usd: 0
CPU 6: hi: 186, btch: 31 usd: 0
CPU 7: hi: 186, btch: 31 usd: 31
CPU 8: hi: 186, btch: 31 usd: 30
CPU 9: hi: 186, btch: 31 usd: 1
CPU 10: hi: 186, btch: 31 usd: 0
CPU 11: hi: 186, btch: 31 usd: 0
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 6
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 29
CPU 17: hi: 186, btch: 31 usd: 5
CPU 18: hi: 186, btch: 31 usd: 0
CPU 19: hi: 186, btch: 31 usd: 1
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 0
active_anon:15141178 inactive_anon:866927 isolated_anon:0
active_file:20 inactive_file:205 isolated_file:22
unevictable:111809 dirty:19 writeback:0 unstable:0
free:42256 slab_reclaimable:5673 slab_unreclaimable:14763
mapped:6558 shmem:438 pagetables:36715 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122060kB min:980kB low:1224kB high:1468kB active_anon:1829216kB inactive_anon:12036kB active_file:0kB inactive_file:56kB unevictable:188kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:0kB writeback:0kB mapped:72kB shmem:20kB slab_reclaimable:436kB slab_unreclaimable:908kB kernel_stack:96kB pagetables:3668kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:964 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14812kB min:15260kB low:19072kB high:22888kB active_anon:28391600kB inactive_anon:1670340kB active_file:172kB inactive_file:636kB unevictable:199608kB isolated(anon):0kB isolated(file):0kB present:31027200kB mlocked:2784kB dirty:232kB writeback:0kB mapped:11480kB shmem:740kB slab_reclaimable:12328kB slab_unreclaimable:37652kB kernel_stack:11176kB pagetables:69924kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:519 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:16292kB min:16276kB low:20344kB high:24412kB active_anon:30343896kB inactive_anon:1785332kB active_file:0kB inactive_file:128kB unevictable:247440kB isolated(anon):0kB isolated(file):88kB present:33095680kB mlocked:2156kB dirty:4kB writeback:0kB mapped:14680kB shmem:992kB slab_reclaimable:9928kB slab_unreclaimable:20492kB kernel_stack:6992kB pagetables:73268kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:245 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 469*4kB 276*8kB 146*16kB 60*32kB 23*64kB 19*128kB 14*256kB 8*512kB 6*1024kB 5*2048kB 21*4096kB = 122324kB
Node 0 Normal: 1081*4kB 155*8kB 105*16kB 41*32kB 13*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 2*2048kB 0*4096kB = 15404kB
Node 1 Normal: 1061*4kB 206*8kB 39*16kB 41*32kB 32*64kB 3*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16404kB
112211 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
28001 pages shared
16466629 pages non-shared
Out of memory: kill process 5322 (java) score 5079 or a child
Killed process 5322 (java) vsz:6501416kB, anon-rss:1081556kB, file-rss:1312kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 13055, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 0
CPU 1: hi: 186, btch: 31 usd: 19
CPU 2: hi: 186, btch: 31 usd: 24
CPU 3: hi: 186, btch: 31 usd: 59
CPU 4: hi: 186, btch: 31 usd: 0
CPU 5: hi: 186, btch: 31 usd: 8
CPU 6: hi: 186, btch: 31 usd: 0
CPU 7: hi: 186, btch: 31 usd: 0
CPU 8: hi: 186, btch: 31 usd: 30
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 28
CPU 11: hi: 186, btch: 31 usd: 0
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 76
CPU 14: hi: 186, btch: 31 usd: 45
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 22
CPU 17: hi: 186, btch: 31 usd: 0
CPU 18: hi: 186, btch: 31 usd: 31
CPU 19: hi: 186, btch: 31 usd: 23
CPU 20: hi: 186, btch: 31 usd: 30
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 0
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 0
CPU 1: hi: 186, btch: 31 usd: 4
CPU 2: hi: 186, btch: 31 usd: 6
CPU 3: hi: 186, btch: 31 usd: 86
CPU 4: hi: 186, btch: 31 usd: 0
CPU 5: hi: 186, btch: 31 usd: 30
CPU 6: hi: 186, btch: 31 usd: 0
CPU 7: hi: 186, btch: 31 usd: 26
CPU 8: hi: 186, btch: 31 usd: 30
CPU 9: hi: 186, btch: 31 usd: 0
CPU 10: hi: 186, btch: 31 usd: 0
CPU 11: hi: 186, btch: 31 usd: 30
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 25
CPU 14: hi: 186, btch: 31 usd: 61
CPU 15: hi: 186, btch: 31 usd: 23
CPU 16: hi: 186, btch: 31 usd: 33
CPU 17: hi: 186, btch: 31 usd: 32
CPU 18: hi: 186, btch: 31 usd: 23
CPU 19: hi: 186, btch: 31 usd: 15
CPU 20: hi: 186, btch: 31 usd: 29
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 31
CPU 23: hi: 186, btch: 31 usd: 31
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 0
CPU 1: hi: 186, btch: 31 usd: 30
CPU 2: hi: 186, btch: 31 usd: 3
CPU 3: hi: 186, btch: 31 usd: 55
CPU 4: hi: 186, btch: 31 usd: 16
CPU 5: hi: 186, btch: 31 usd: 6
CPU 6: hi: 186, btch: 31 usd: 0
CPU 7: hi: 186, btch: 31 usd: 31
CPU 8: hi: 186, btch: 31 usd: 54
CPU 9: hi: 186, btch: 31 usd: 20
CPU 10: hi: 186, btch: 31 usd: 0
CPU 11: hi: 186, btch: 31 usd: 0
CPU 12: hi: 186, btch: 31 usd: 0
CPU 13: hi: 186, btch: 31 usd: 22
CPU 14: hi: 186, btch: 31 usd: 6
CPU 15: hi: 186, btch: 31 usd: 30
CPU 16: hi: 186, btch: 31 usd: 21
CPU 17: hi: 186, btch: 31 usd: 5
CPU 18: hi: 186, btch: 31 usd: 0
CPU 19: hi: 186, btch: 31 usd: 1
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 0
active_anon:15141332 inactive_anon:866927 isolated_anon:0
active_file:58 inactive_file:492 isolated_file:32
unevictable:111809 dirty:0 writeback:0 unstable:0
free:42007 slab_reclaimable:5673 slab_unreclaimable:14763
mapped:6616 shmem:438 pagetables:36724 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122076kB min:980kB low:1224kB high:1468kB active_anon:1829328kB inactive_anon:12036kB active_file:104kB inactive_file:116kB unevictable:188kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:0kB writeback:0kB mapped:32kB shmem:20kB slab_reclaimable:436kB slab_unreclaimable:900kB kernel_stack:96kB pagetables:3676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:964 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14888kB min:15260kB low:19072kB high:22888kB active_anon:28391916kB inactive_anon:1670340kB active_file:120kB inactive_file:904kB unevictable:199608kB isolated(anon):0kB isolated(file):128kB present:31027200kB mlocked:2784kB dirty:52kB writeback:0kB mapped:11656kB shmem:740kB slab_reclaimable:12328kB slab_unreclaimable:37652kB kernel_stack:11176kB pagetables:69940kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:519 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15204kB min:16276kB low:20344kB high:24412kB active_anon:30344084kB inactive_anon:1785332kB active_file:8kB inactive_file:948kB unevictable:247440kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2156kB dirty:0kB writeback:0kB mapped:14776kB shmem:992kB slab_reclaimable:9928kB slab_unreclaimable:20500kB kernel_stack:6992kB pagetables:73280kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:245 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 469*4kB 277*8kB 105*16kB 57*32kB 23*64kB 19*128kB 14*256kB 8*512kB 6*1024kB 5*2048kB 21*4096kB = 121580kB
Node 0 Normal: 980*4kB 139*8kB 90*16kB 33*32kB 2*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 2*2048kB 0*4096kB = 13544kB
Node 1 Normal: 1031*4kB 205*8kB 38*16kB 27*32kB 18*64kB 3*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 14916kB
112509 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
28126 pages shared
16466827 pages non-shared
Out of memory: kill process 4388 (java) score 4617 or a child
Killed process 4388 (java) vsz:6501416kB, anon-rss:1164436kB, file-rss:1356kB
init: whoopsie main process (1984) killed by KILL signal
init: whoopsie main process ended, respawning
CPU15: Core power limit normal
CPU4: Core power limit normal
CPU13: Core power limit normal
CPU1: Core power limit normal
CPU3: Core power limit normal
CPU2: Core power limit normal
CPU12: Core power limit normal
CPU16: Core power limit normal
CPU17: Core power limit normal
CPU5: Core power limit normal
CPU14: Core power limit normal
CPU0: Core power limit normal
CPU4: Package power limit normal
CPU13: Package power limit normal
CPU1: Package power limit normal
CPU3: Package power limit normal
CPU2: Package power limit normal
CPU12: Package power limit normal
CPU16: Package power limit normal
CPU17: Package power limit normal
CPU5: Package power limit normal
CPU14: Package power limit normal
CPU0: Package power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU19: Core power limit normal
CPU9: Core power limit normal
CPU21: Core power limit normal
CPU7: Core power limit normal
CPU8: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU20: Core power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU19: Package power limit normal
CPU9: Package power limit normal
CPU21: Package power limit normal
CPU7: Package power limit normal
CPU8: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU20: Package power limit normal
CPU15: Package power limit notification (total events = 51417)
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU9: Core power limit normal
CPU21: Core power limit normal
CPU19: Core power limit normal
CPU7: Core power limit normal
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU20: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU9: Package power limit normal
CPU21: Package power limit normal
CPU19: Package power limit normal
CPU7: Package power limit normal
CPU22: Package power limit normal
CPU10: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU3: Core power limit normal
CPU15: Core power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU17: Core power limit normal
CPU2: Core power limit normal
CPU5: Core power limit normal
CPU1: Core power limit normal
CPU13: Core power limit normal
CPU14: Core power limit normal
CPU0: Core power limit normal
CPU12: Core power limit normal
CPU3: Package power limit normal
CPU15: Package power limit normal
CPU4: Package power limit normal
CPU16: Package power limit normal
CPU17: Package power limit normal
CPU2: Package power limit normal
CPU5: Package power limit normal
CPU1: Package power limit normal
CPU13: Package power limit normal
CPU14: Package power limit normal
CPU0: Package power limit normal
CPU12: Package power limit normal
CPU8: Package power limit notification (total events = 55472)
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU3: Core power limit normal
CPU15: Core power limit normal
CPU16: Core power limit normal
CPU4: Core power limit normal
CPU13: Core power limit normal
CPU1: Core power limit normal
CPU14: Core power limit normal
CPU0: Core power limit normal
CPU12: Core power limit normal
CPU2: Core power limit normal
CPU17: Package power limit normal
CPU3: Package power limit normal
CPU15: Package power limit normal
CPU16: Package power limit normal
CPU4: Package power limit normal
CPU13: Package power limit normal
CPU1: Package power limit normal
CPU14: Package power limit normal
CPU0: Package power limit normal
CPU12: Package power limit normal
CPU2: Package power limit normal
CPU11: Core power limit normal
CPU23: Core power limit normal
CPU20: Core power limit normal
CPU9: Core power limit normal
CPU7: Core power limit normal
CPU21: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU19: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU8: Core power limit normal
CPU11: Package power limit normal
CPU23: Package power limit normal
CPU20: Package power limit normal
CPU9: Package power limit normal
CPU7: Package power limit normal
CPU21: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU19: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU8: Package power limit normal
CPU5: Package power limit notification (total events = 51353)
CPU19: Core power limit normal
CPU7: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU18: Core power limit normal
CPU20: Core power limit normal
CPU21: Core power limit normal
CPU6: Core power limit normal
CPU8: Core power limit normal
CPU11: Core power limit normal
CPU23: Core power limit normal
CPU9: Core power limit normal
CPU7: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU18: Package power limit normal
CPU20: Package power limit normal
CPU21: Package power limit normal
CPU6: Package power limit normal
CPU8: Package power limit normal
CPU11: Package power limit normal
CPU23: Package power limit normal
CPU9: Package power limit normal
CPU19: Package power limit notification (total events = 55436)
CPU17: Core power limit normal
CPU5: Core power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU2: Core power limit normal
CPU3: Core power limit normal
CPU15: Core power limit normal
CPU14: Core power limit normal
CPU1: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU13: Core power limit normal
CPU5: Package power limit normal
CPU4: Package power limit normal
CPU16: Package power limit normal
CPU2: Package power limit normal
CPU3: Package power limit normal
CPU15: Package power limit normal
CPU14: Package power limit normal
CPU1: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU13: Package power limit normal
CPU17: Package power limit notification (total events = 51360)
CPU18: Core power limit normal
CPU11: Core power limit normal
CPU6: Core power limit normal
CPU21: Core power limit normal
CPU7: Core power limit normal
CPU9: Core power limit normal
CPU23: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU19: Core power limit normal
CPU20: Core power limit normal
CPU8: Core power limit normal
CPU11: Package power limit normal
CPU6: Package power limit normal
CPU21: Package power limit normal
CPU7: Package power limit normal
CPU9: Package power limit normal
CPU23: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU19: Package power limit normal
CPU20: Package power limit normal
CPU8: Package power limit normal
CPU18: Package power limit notification (total events = 55806)
CPU13: Core power limit normal
CPU3: Core power limit normal
CPU0: Core power limit normal
CPU4: Core power limit normal
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU15: Core power limit normal
CPU1: Core power limit normal
CPU14: Core power limit normal
CPU2: Core power limit normal
CPU12: Core power limit normal
CPU16: Core power limit normal
CPU3: Package power limit normal
CPU0: Package power limit normal
CPU4: Package power limit normal
CPU5: Package power limit normal
CPU17: Package power limit normal
CPU15: Package power limit normal
CPU1: Package power limit normal
CPU14: Package power limit normal
CPU2: Package power limit normal
CPU12: Package power limit normal
CPU16: Package power limit normal
CPU13: Package power limit notification (total events = 51502)
CPU10: Core power limit normal
CPU23: Core power limit normal
CPU22: Core power limit normal
CPU20: Core power limit normal
CPU9: Core power limit normal
CPU7: Core power limit normal
CPU11: Core power limit normal
CPU19: Core power limit normal
CPU21: Core power limit normal
CPU8: Core power limit normal
CPU18: Core power limit normal
CPU6: Core power limit normal
CPU23: Package power limit normal
CPU22: Package power limit normal
CPU20: Package power limit normal
CPU9: Package power limit normal
CPU7: Package power limit normal
CPU11: Package power limit normal
CPU19: Package power limit normal
CPU21: Package power limit normal
CPU8: Package power limit normal
CPU18: Package power limit normal
CPU6: Package power limit normal
CPU10: Package power limit notification (total events = 55181)
CPU17: Core power limit normal
CPU5: Core power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU3: Core power limit normal
CPU15: Core power limit normal
CPU2: Core power limit normal
CPU1: Core power limit normal
CPU14: Core power limit normal
CPU12: Core power limit normal
CPU13: Core power limit normal
CPU0: Core power limit normal
CPU5: Package power limit normal
CPU4: Package power limit normal
CPU16: Package power limit normal
CPU3: Package power limit normal
CPU15: Package power limit normal
CPU2: Package power limit normal
CPU1: Package power limit normal
CPU14: Package power limit normal
CPU12: Package power limit normal
CPU13: Package power limit normal
CPU0: Package power limit normal
CPU17: Package power limit notification (total events = 51368)
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU9: Core power limit normal
CPU21: Core power limit normal
CPU18: Core power limit normal
CPU6: Core power limit normal
CPU7: Core power limit normal
CPU19: Core power limit normal
CPU10: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU9: Package power limit normal
CPU21: Package power limit normal
CPU18: Package power limit normal
CPU6: Package power limit normal
CPU7: Package power limit normal
CPU19: Package power limit normal
CPU22: Package power limit notification (total events = 55193)
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU17: Core power limit normal
CPU5: Core power limit normal
CPU3: Core power limit normal
CPU2: Core power limit normal
CPU14: Core power limit normal
CPU13: Core power limit normal
CPU1: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU15: Core power limit normal
CPU16: Package power limit normal
CPU17: Package power limit normal
CPU5: Package power limit normal
CPU3: Package power limit normal
CPU2: Package power limit normal
CPU14: Package power limit normal
CPU13: Package power limit normal
CPU1: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU15: Package power limit normal
CPU4: Package power limit notification (total events = 51447)
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU9: Core power limit normal
CPU11: Core power limit normal
CPU23: Core power limit normal
CPU6: Core power limit normal
CPU21: Core power limit normal
CPU19: Core power limit normal
CPU18: Core power limit normal
CPU7: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU10: Package power limit normal
CPU9: Package power limit normal
CPU11: Package power limit normal
CPU23: Package power limit normal
CPU6: Package power limit normal
CPU21: Package power limit normal
CPU19: Package power limit normal
CPU18: Package power limit normal
CPU7: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU22: Package power limit notification (total events = 55200)
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU17: Core power limit normal
CPU3: Core power limit normal
CPU5: Core power limit normal
CPU15: Core power limit normal
CPU1: Core power limit normal
CPU13: Core power limit normal
CPU2: Core power limit normal
CPU14: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU16: Package power limit normal
CPU17: Package power limit normal
CPU3: Package power limit normal
CPU5: Package power limit normal
CPU15: Package power limit normal
CPU1: Package power limit normal
CPU13: Package power limit normal
CPU2: Package power limit normal
CPU14: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU4: Package power limit notification (total events = 51454)
CPU11: Core power limit normal
CPU9: Core power limit normal
CPU23: Core power limit normal
CPU21: Core power limit normal
CPU6: Core power limit normal
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU18: Core power limit normal
CPU7: Core power limit normal
CPU19: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU9: Package power limit normal
CPU23: Package power limit normal
CPU21: Package power limit normal
CPU6: Package power limit normal
CPU22: Package power limit normal
CPU10: Package power limit normal
CPU18: Package power limit normal
CPU7: Package power limit normal
CPU19: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU11: Package power limit notification (total events = 55131)
CPU5: Core power limit normal
CPU15: Core power limit normal
CPU17: Core power limit normal
CPU1: Core power limit normal
CPU14: Core power limit normal
CPU2: Core power limit normal
CPU13: Core power limit normal
CPU16: Core power limit normal
CPU4: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU3: Core power limit normal
CPU15: Package power limit normal
CPU17: Package power limit normal
CPU1: Package power limit normal
CPU14: Package power limit normal
CPU2: Package power limit normal
CPU13: Package power limit normal
CPU16: Package power limit normal
CPU4: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU3: Package power limit normal
CPU5: Package power limit notification (total events = 51388)
CPU21: Core power limit normal
CPU9: Core power limit normal
CPU20: Core power limit normal
CPU8: Core power limit normal
CPU18: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU6: Core power limit normal
CPU7: Core power limit normal
CPU19: Core power limit normal
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU9: Package power limit normal
CPU20: Package power limit normal
CPU8: Package power limit normal
CPU18: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU6: Package power limit normal
CPU7: Package power limit normal
CPU19: Package power limit normal
CPU22: Package power limit normal
CPU10: Package power limit normal
CPU21: Package power limit notification (total events = 55438)
CPU15: Core power limit normal
CPU17: Core power limit normal
CPU16: Core power limit normal
CPU2: Core power limit normal
CPU3: Core power limit normal
CPU14: Core power limit normal
CPU4: Core power limit normal
CPU0: Core power limit normal
CPU12: Core power limit normal
CPU13: Core power limit normal
CPU5: Core power limit normal
CPU1: Core power limit normal
CPU17: Package power limit normal
CPU16: Package power limit normal
CPU2: Package power limit normal
CPU3: Package power limit normal
CPU14: Package power limit normal
CPU4: Package power limit normal
CPU0: Package power limit normal
CPU12: Package power limit normal
CPU13: Package power limit normal
CPU5: Package power limit normal
CPU1: Package power limit normal
CPU15: Package power limit notification (total events = 51472)
CPU11: Core power limit normal
CPU23: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU19: Core power limit normal
CPU7: Core power limit normal
CPU21: Core power limit normal
CPU9: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU23: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU19: Package power limit normal
CPU7: Package power limit normal
CPU21: Package power limit normal
CPU9: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU11: Package power limit notification (total events = 55155)
CPU2: Core power limit normal
CPU16: Core power limit normal
CPU17: Core power limit normal
CPU5: Core power limit normal
CPU14: Core power limit normal
CPU4: Core power limit normal
CPU13: Core power limit normal
CPU1: Core power limit normal
CPU0: Core power limit normal
CPU3: Core power limit normal
CPU15: Core power limit normal
CPU12: Core power limit normal
CPU16: Package power limit normal
CPU17: Package power limit normal
CPU5: Package power limit normal
CPU14: Package power limit normal
CPU4: Package power limit normal
CPU13: Package power limit normal
CPU1: Package power limit normal
CPU0: Package power limit normal
CPU3: Package power limit normal
CPU15: Package power limit normal
CPU12: Package power limit normal
CPU2: Package power limit notification (total events = 51503)
CPU9: Core power limit normal
CPU21: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU19: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU20: Core power limit normal
CPU8: Core power limit normal
CPU7: Core power limit normal
CPU21: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU19: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU20: Package power limit normal
CPU8: Package power limit normal
CPU7: Package power limit normal
CPU9: Package power limit notification (total events = 55437)
CPU16: Core power limit normal
CPU4: Core power limit normal
CPU3: Core power limit normal
CPU14: Core power limit normal
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU2: Core power limit normal
CPU13: Core power limit normal
CPU1: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU15: Core power limit normal
CPU4: Package power limit normal
CPU3: Package power limit normal
CPU14: Package power limit normal
CPU5: Package power limit normal
CPU17: Package power limit normal
CPU2: Package power limit normal
CPU13: Package power limit normal
CPU1: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU15: Package power limit normal
CPU16: Package power limit notification (total events = 51493)
CPU21: Core power limit normal
CPU22: Core power limit normal
CPU9: Core power limit normal
CPU10: Core power limit normal
CPU7: Core power limit normal
CPU20: Core power limit normal
CPU19: Core power limit normal
CPU23: Core power limit normal
CPU8: Core power limit normal
CPU11: Core power limit normal
CPU18: Core power limit normal
CPU6: Core power limit normal
CPU22: Package power limit normal
CPU9: Package power limit normal
CPU10: Package power limit normal
CPU7: Package power limit normal
CPU20: Package power limit normal
CPU19: Package power limit normal
CPU23: Package power limit normal
CPU8: Package power limit normal
CPU11: Package power limit normal
CPU18: Package power limit normal
CPU6: Package power limit normal
CPU21: Package power limit notification (total events = 55469)
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU7: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU19: Core power limit normal
CPU9: Core power limit normal
CPU21: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU11: Package power limit normal
CPU7: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU19: Package power limit normal
CPU9: Package power limit normal
CPU21: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU23: Package power limit normal
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU2: Core power limit normal
CPU14: Core power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU15: Core power limit normal
CPU3: Core power limit normal
CPU12: Core power limit normal
CPU1: Core power limit normal
CPU13: Core power limit normal
CPU0: Core power limit normal
CPU17: Package power limit normal
CPU2: Package power limit normal
CPU14: Package power limit normal
CPU4: Package power limit normal
CPU16: Package power limit normal
CPU15: Package power limit normal
CPU3: Package power limit normal
CPU12: Package power limit normal
CPU1: Package power limit normal
CPU13: Package power limit normal
CPU0: Package power limit normal
CPU5: Package power limit notification (total events = 51423)
stresscpu2_linu invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
stresscpu2_linu cpuset=/ mems_allowed=0-1
Pid: 37433, comm: stresscpu2_linu Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] ? delayacct_end+0x89/0xa0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] ? __switch_to+0x26e/0x320
[] handle_mm_fault+0x1b9/0x440
[] ? schedule+0x3e1/0x830
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 165
CPU 2: hi: 186, btch: 31 usd: 119
CPU 3: hi: 186, btch: 31 usd: 48
CPU 4: hi: 186, btch: 31 usd: 172
CPU 5: hi: 186, btch: 31 usd: 106
CPU 6: hi: 186, btch: 31 usd: 82
CPU 7: hi: 186, btch: 31 usd: 0
CPU 8: hi: 186, btch: 31 usd: 165
CPU 9: hi: 186, btch: 31 usd: 153
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 142
CPU 12: hi: 186, btch: 31 usd: 38
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 94
CPU 15: hi: 186, btch: 31 usd: 60
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 27
CPU 19: hi: 186, btch: 31 usd: 1
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 108
CPU 23: hi: 186, btch: 31 usd: 82
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 82
CPU 1: hi: 186, btch: 31 usd: 104
CPU 2: hi: 186, btch: 31 usd: 102
CPU 3: hi: 186, btch: 31 usd: 137
CPU 4: hi: 186, btch: 31 usd: 121
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 65
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 180
CPU 9: hi: 186, btch: 31 usd: 155
CPU 10: hi: 186, btch: 31 usd: 124
CPU 11: hi: 186, btch: 31 usd: 114
CPU 12: hi: 186, btch: 31 usd: 160
CPU 13: hi: 186, btch: 31 usd: 68
CPU 14: hi: 186, btch: 31 usd: 116
CPU 15: hi: 186, btch: 31 usd: 40
CPU 16: hi: 186, btch: 31 usd: 129
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 65
CPU 19: hi: 186, btch: 31 usd: 7
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 27
CPU 22: hi: 186, btch: 31 usd: 8
CPU 23: hi: 186, btch: 31 usd: 72
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 111
CPU 1: hi: 186, btch: 31 usd: 183
CPU 2: hi: 186, btch: 31 usd: 167
CPU 3: hi: 186, btch: 31 usd: 0
CPU 4: hi: 186, btch: 31 usd: 164
CPU 5: hi: 186, btch: 31 usd: 33
CPU 6: hi: 186, btch: 31 usd: 89
CPU 7: hi: 186, btch: 31 usd: 118
CPU 8: hi: 186, btch: 31 usd: 182
CPU 9: hi: 186, btch: 31 usd: 134
CPU 10: hi: 186, btch: 31 usd: 54
CPU 11: hi: 186, btch: 31 usd: 169
CPU 12: hi: 186, btch: 31 usd: 30
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 31
CPU 15: hi: 186, btch: 31 usd: 16
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 155
CPU 19: hi: 186, btch: 31 usd: 164
CPU 20: hi: 186, btch: 31 usd: 116
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 166
CPU 23: hi: 186, btch: 31 usd: 67
active_anon:15114007 inactive_anon:874485 isolated_anon:0
active_file:107 inactive_file:164 isolated_file:0
unevictable:127190 dirty:214 writeback:0 unstable:0
free:42269 slab_reclaimable:5636 slab_unreclaimable:14487
mapped:6424 shmem:474 pagetables:36682 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122140kB min:980kB low:1224kB high:1468kB active_anon:1788748kB inactive_anon:48004kB active_file:208kB inactive_file:96kB unevictable:20kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:0kB writeback:32kB mapped:88kB shmem:20kB slab_reclaimable:352kB slab_unreclaimable:380kB kernel_stack:16kB pagetables:3612kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:320 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:15184kB min:15260kB low:19072kB high:22888kB active_anon:28338448kB inactive_anon:1667172kB active_file:76kB inactive_file:352kB unevictable:251936kB isolated(anon):0kB isolated(file):0kB present:31027200kB mlocked:55232kB dirty:716kB writeback:0kB mapped:11464kB shmem:772kB slab_reclaimable:12076kB slab_unreclaimable:36584kB kernel_stack:9824kB pagetables:69720kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:669 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:16140kB min:16276kB low:20344kB high:24412kB active_anon:30327552kB inactive_anon:1784044kB active_file:152kB inactive_file:328kB unevictable:256804kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:11444kB dirty:248kB writeback:0kB mapped:14084kB shmem:1104kB slab_reclaimable:10116kB slab_unreclaimable:20984kB kernel_stack:6688kB pagetables:73396kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:742 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 267*4kB 191*8kB 118*16kB 65*32kB 38*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 121892kB
Node 0 Normal: 506*4kB 259*8kB 141*16kB 70*32kB 29*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 14928kB
Node 1 Normal: 349*4kB 121*8kB 82*16kB 60*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16348kB
112703 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
28219 pages shared
16461639 pages non-shared
Out of memory: kill process 7844 (rsyslogd) score 63904 or a child
Killed process 7844 (rsyslogd) vsz:255616kB, anon-rss:544kB, file-rss:300kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 51054, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] ? check_preempt_wakeup+0x1c5/0x290
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 144
CPU 3: hi: 186, btch: 31 usd: 47
CPU 4: hi: 186, btch: 31 usd: 124
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 77
CPU 7: hi: 186, btch: 31 usd: 31
CPU 8: hi: 186, btch: 31 usd: 166
CPU 9: hi: 186, btch: 31 usd: 110
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 142
CPU 12: hi: 186, btch: 31 usd: 38
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 135
CPU 15: hi: 186, btch: 31 usd: 60
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 29
CPU 19: hi: 186, btch: 31 usd: 32
CPU 20: hi: 186, btch: 31 usd: 31
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 81
CPU 23: hi: 186, btch: 31 usd: 82
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 112
CPU 1: hi: 186, btch: 31 usd: 171
CPU 2: hi: 186, btch: 31 usd: 114
CPU 3: hi: 186, btch: 31 usd: 84
CPU 4: hi: 186, btch: 31 usd: 180
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 128
CPU 7: hi: 186, btch: 31 usd: 36
CPU 8: hi: 186, btch: 31 usd: 149
CPU 9: hi: 186, btch: 31 usd: 93
CPU 10: hi: 186, btch: 31 usd: 124
CPU 11: hi: 186, btch: 31 usd: 83
CPU 12: hi: 186, btch: 31 usd: 160
CPU 13: hi: 186, btch: 31 usd: 68
CPU 14: hi: 186, btch: 31 usd: 116
CPU 15: hi: 186, btch: 31 usd: 40
CPU 16: hi: 186, btch: 31 usd: 129
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 93
CPU 19: hi: 186, btch: 31 usd: 0
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 27
CPU 22: hi: 186, btch: 31 usd: 17
CPU 23: hi: 186, btch: 31 usd: 72
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 111
CPU 1: hi: 186, btch: 31 usd: 182
CPU 2: hi: 186, btch: 31 usd: 167
CPU 3: hi: 186, btch: 31 usd: 21
CPU 4: hi: 186, btch: 31 usd: 107
CPU 5: hi: 186, btch: 31 usd: 33
CPU 6: hi: 186, btch: 31 usd: 85
CPU 7: hi: 186, btch: 31 usd: 176
CPU 8: hi: 186, btch: 31 usd: 182
CPU 9: hi: 186, btch: 31 usd: 134
CPU 10: hi: 186, btch: 31 usd: 54
CPU 11: hi: 186, btch: 31 usd: 169
CPU 12: hi: 186, btch: 31 usd: 30
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 43
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 155
CPU 19: hi: 186, btch: 31 usd: 164
CPU 20: hi: 186, btch: 31 usd: 118
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 166
CPU 23: hi: 186, btch: 31 usd: 67
active_anon:15113383 inactive_anon:875125 isolated_anon:0
active_file:158 inactive_file:116 isolated_file:192
unevictable:127243 dirty:75 writeback:0 unstable:0
free:42226 slab_reclaimable:5522 slab_unreclaimable:14507
mapped:6379 shmem:474 pagetables:36642 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:121892kB min:980kB low:1224kB high:1468kB active_anon:1787556kB inactive_anon:49284kB active_file:0kB inactive_file:404kB unevictable:36kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:48kB writeback:0kB mapped:92kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:16kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:832 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:15176kB min:15260kB low:19072kB high:22888kB active_anon:28338560kB inactive_anon:1667172kB active_file:472kB inactive_file:44kB unevictable:252132kB isolated(anon):0kB isolated(file):512kB present:31027200kB mlocked:55232kB dirty:80kB writeback:0kB mapped:11428kB shmem:772kB slab_reclaimable:11948kB slab_unreclaimable:36620kB kernel_stack:9784kB pagetables:69556kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:857 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15976kB min:16276kB low:20344kB high:24412kB active_anon:30327416kB inactive_anon:1784044kB active_file:160kB inactive_file:16kB unevictable:256804kB isolated(anon):0kB isolated(file):256kB present:33095680kB mlocked:11444kB dirty:172kB writeback:0kB mapped:13996kB shmem:1104kB slab_reclaimable:9916kB slab_unreclaimable:21028kB kernel_stack:6688kB pagetables:73392kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:67 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 294*4kB 191*8kB 118*16kB 65*32kB 38*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 122000kB
Node 0 Normal: 592*4kB 262*8kB 144*16kB 70*32kB 29*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 15344kB
Node 1 Normal: 312*4kB 121*8kB 57*16kB 60*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 15800kB
112410 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
28188 pages shared
16461508 pages non-shared
Out of memory: kill process 7907 (whoopsie) score 50536 or a child
Killed process 7907 (whoopsie) vsz:202144kB, anon-rss:1308kB, file-rss:780kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 6453, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 144
CPU 3: hi: 186, btch: 31 usd: 51
CPU 4: hi: 186, btch: 31 usd: 124
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 85
CPU 7: hi: 186, btch: 31 usd: 0
CPU 8: hi: 186, btch: 31 usd: 135
CPU 9: hi: 186, btch: 31 usd: 110
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 142
CPU 12: hi: 186, btch: 31 usd: 38
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 135
CPU 15: hi: 186, btch: 31 usd: 60
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 29
CPU 19: hi: 186, btch: 31 usd: 1
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 50
CPU 23: hi: 186, btch: 31 usd: 82
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 180
CPU 1: hi: 186, btch: 31 usd: 171
CPU 2: hi: 186, btch: 31 usd: 82
CPU 3: hi: 186, btch: 31 usd: 84
CPU 4: hi: 186, btch: 31 usd: 180
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 172
CPU 7: hi: 186, btch: 31 usd: 37
CPU 8: hi: 186, btch: 31 usd: 174
CPU 9: hi: 186, btch: 31 usd: 93
CPU 10: hi: 186, btch: 31 usd: 183
CPU 11: hi: 186, btch: 31 usd: 82
CPU 12: hi: 186, btch: 31 usd: 170
CPU 13: hi: 186, btch: 31 usd: 73
CPU 14: hi: 186, btch: 31 usd: 116
CPU 15: hi: 186, btch: 31 usd: 40
CPU 16: hi: 186, btch: 31 usd: 129
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 130
CPU 19: hi: 186, btch: 31 usd: 45
CPU 20: hi: 186, btch: 31 usd: 1
CPU 21: hi: 186, btch: 31 usd: 27
CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 74
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 116
CPU 1: hi: 186, btch: 31 usd: 182
CPU 2: hi: 186, btch: 31 usd: 167
CPU 3: hi: 186, btch: 31 usd: 22
CPU 4: hi: 186, btch: 31 usd: 107
CPU 5: hi: 186, btch: 31 usd: 33
CPU 6: hi: 186, btch: 31 usd: 76
CPU 7: hi: 186, btch: 31 usd: 174
CPU 8: hi: 186, btch: 31 usd: 182
CPU 9: hi: 186, btch: 31 usd: 161
CPU 10: hi: 186, btch: 31 usd: 59
CPU 11: hi: 186, btch: 31 usd: 169
CPU 12: hi: 186, btch: 31 usd: 184
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 43
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 158
CPU 19: hi: 186, btch: 31 usd: 164
CPU 20: hi: 186, btch: 31 usd: 118
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 166
CPU 23: hi: 186, btch: 31 usd: 79
active_anon:15112464 inactive_anon:875637 isolated_anon:0
active_file:151 inactive_file:322 isolated_file:161
unevictable:127243 dirty:86 writeback:3 unstable:0
free:42251 slab_reclaimable:5520 slab_unreclaimable:14501
mapped:6357 shmem:474 pagetables:36642 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122000kB min:980kB low:1224kB high:1468kB active_anon:1785508kB inactive_anon:51332kB active_file:0kB inactive_file:76kB unevictable:36kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:36kB writeback:0kB mapped:28kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:16kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:128 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:15204kB min:15260kB low:19072kB high:22888kB active_anon:28337476kB inactive_anon:1667172kB active_file:472kB inactive_file:680kB unevictable:252132kB isolated(anon):0kB isolated(file):384kB present:31027200kB mlocked:55232kB dirty:72kB writeback:16kB mapped:11412kB shmem:772kB slab_reclaimable:11944kB slab_unreclaimable:36620kB kernel_stack:9784kB pagetables:69556kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1836 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15940kB min:16276kB low:20344kB high:24412kB active_anon:30326872kB inactive_anon:1784044kB active_file:132kB inactive_file:532kB unevictable:256804kB isolated(anon):0kB isolated(file):260kB present:33095680kB mlocked:11444kB dirty:236kB writeback:28kB mapped:13988kB shmem:1104kB slab_reclaimable:9912kB slab_unreclaimable:21004kB kernel_stack:6688kB pagetables:73392kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:24758 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 399*4kB 199*8kB 119*16kB 69*32kB 38*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 122628kB
Node 0 Normal: 617*4kB 264*8kB 143*16kB 69*32kB 29*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 15412kB
Node 1 Normal: 393*4kB 127*8kB 57*16kB 60*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16172kB
112354 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
27656 pages shared
16461135 pages non-shared
Out of memory: kill process 6763 (nrsysmond) score 14049 or a child
Killed process 6763 (nrsysmond) vsz:112392kB, anon-rss:1012kB, file-rss:688kB
stresscpu2_linu invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
stresscpu2_linu cpuset=/ mems_allowed=0-1
Pid: 37445, comm: stresscpu2_linu Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] ? check_preempt_wakeup+0x1b4/0x290
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] ? apic_timer_interrupt+0xe/0x20
[] ? __rb_erase_color+0x12d/0x1d0
[] ? __switch_to+0x26e/0x320
[] handle_mm_fault+0x1b9/0x440
[] ? schedule+0x3e1/0x830
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 144
CPU 3: hi: 186, btch: 31 usd: 47
CPU 4: hi: 186, btch: 31 usd: 124
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 87
CPU 7: hi: 186, btch: 31 usd: 0
CPU 8: hi: 186, btch: 31 usd: 135
CPU 9: hi: 186, btch: 31 usd: 74
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 111
CPU 12: hi: 186, btch: 31 usd: 38
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 135
CPU 15: hi: 186, btch: 31 usd: 60
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 29
CPU 19: hi: 186, btch: 31 usd: 1
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 50
CPU 23: hi: 186, btch: 31 usd: 82
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 38
CPU 1: hi: 186, btch: 31 usd: 171
CPU 2: hi: 186, btch: 31 usd: 81
CPU 3: hi: 186, btch: 31 usd: 62
CPU 4: hi: 186, btch: 31 usd: 137
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 53
CPU 7: hi: 186, btch: 31 usd: 14
CPU 8: hi: 186, btch: 31 usd: 166
CPU 9: hi: 186, btch: 31 usd: 20
CPU 10: hi: 186, btch: 31 usd: 183
CPU 11: hi: 186, btch: 31 usd: 94
CPU 12: hi: 186, btch: 31 usd: 115
CPU 13: hi: 186, btch: 31 usd: 73
CPU 14: hi: 186, btch: 31 usd: 116
CPU 15: hi: 186, btch: 31 usd: 28
CPU 16: hi: 186, btch: 31 usd: 129
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 108
CPU 19: hi: 186, btch: 31 usd: 134
CPU 20: hi: 186, btch: 31 usd: 55
CPU 21: hi: 186, btch: 31 usd: 27
CPU 22: hi: 186, btch: 31 usd: 0
CPU 23: hi: 186, btch: 31 usd: 92
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 116
CPU 1: hi: 186, btch: 31 usd: 174
CPU 2: hi: 186, btch: 31 usd: 188
CPU 3: hi: 186, btch: 31 usd: 145
CPU 4: hi: 186, btch: 31 usd: 107
CPU 5: hi: 186, btch: 31 usd: 62
CPU 6: hi: 186, btch: 31 usd: 85
CPU 7: hi: 186, btch: 31 usd: 157
CPU 8: hi: 186, btch: 31 usd: 167
CPU 9: hi: 186, btch: 31 usd: 170
CPU 10: hi: 186, btch: 31 usd: 51
CPU 11: hi: 186, btch: 31 usd: 187
CPU 12: hi: 186, btch: 31 usd: 175
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 43
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 176
CPU 19: hi: 186, btch: 31 usd: 179
CPU 20: hi: 186, btch: 31 usd: 163
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 166
CPU 23: hi: 186, btch: 31 usd: 81
active_anon:15111997 inactive_anon:875765 isolated_anon:0
active_file:108 inactive_file:658 isolated_file:32
unevictable:127243 dirty:18 writeback:0 unstable:0
free:42189 slab_reclaimable:5519 slab_unreclaimable:14503
mapped:6354 shmem:474 pagetables:36573 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122008kB min:980kB low:1224kB high:1468kB active_anon:1784996kB inactive_anon:51844kB active_file:20kB inactive_file:352kB unevictable:36kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:4kB writeback:0kB mapped:4kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:8kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:232 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14964kB min:15260kB low:19072kB high:22888kB active_anon:28337148kB inactive_anon:1667172kB active_file:212kB inactive_file:1980kB unevictable:252132kB isolated(anon):0kB isolated(file):0kB present:31027200kB mlocked:55232kB dirty:32kB writeback:0kB mapped:11500kB shmem:772kB slab_reclaimable:11944kB slab_unreclaimable:36616kB kernel_stack:9784kB pagetables:69488kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:4169 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15924kB min:16276kB low:20344kB high:24412kB active_anon:30325844kB inactive_anon:1784044kB active_file:200kB inactive_file:300kB unevictable:256804kB isolated(anon):0kB isolated(file):128kB present:33095680kB mlocked:11444kB dirty:36kB writeback:0kB mapped:13912kB shmem:1104kB slab_reclaimable:9908kB slab_unreclaimable:21016kB kernel_stack:6688kB pagetables:73184kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:4303 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 391*4kB 203*8kB 119*16kB 69*32kB 38*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 122628kB
Node 0 Normal: 524*4kB 259*8kB 142*16kB 55*32kB 29*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 14536kB
Node 1 Normal: 495*4kB 134*8kB 37*16kB 55*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16156kB
113080 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
27165 pages shared
16461199 pages non-shared
Out of memory: kill process 6208 (pickup) score 6793 or a child
Killed process 6208 (pickup) vsz:27172kB, anon-rss:272kB, file-rss:556kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 51212, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] ? delayacct_end+0x89/0xa0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 144
CPU 3: hi: 186, btch: 31 usd: 47
CPU 4: hi: 186, btch: 31 usd: 124
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 91
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 128
CPU 9: hi: 186, btch: 31 usd: 74
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 111
CPU 12: hi: 186, btch: 31 usd: 30
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 103
CPU 15: hi: 186, btch: 31 usd: 60
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 19
CPU 19: hi: 186, btch: 31 usd: 17
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 62
CPU 22: hi: 186, btch: 31 usd: 50
CPU 23: hi: 186, btch: 31 usd: 82
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 38
CPU 1: hi: 186, btch: 31 usd: 160
CPU 2: hi: 186, btch: 31 usd: 81
CPU 3: hi: 186, btch: 31 usd: 142
CPU 4: hi: 186, btch: 31 usd: 137
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 149
CPU 7: hi: 186, btch: 31 usd: 93
CPU 8: hi: 186, btch: 31 usd: 160
CPU 9: hi: 186, btch: 31 usd: 49
CPU 10: hi: 186, btch: 31 usd: 128
CPU 11: hi: 186, btch: 31 usd: 101
CPU 12: hi: 186, btch: 31 usd: 170
CPU 13: hi: 186, btch: 31 usd: 72
CPU 14: hi: 186, btch: 31 usd: 140
CPU 15: hi: 186, btch: 31 usd: 28
CPU 16: hi: 186, btch: 31 usd: 129
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 182
CPU 19: hi: 186, btch: 31 usd: 148
CPU 20: hi: 186, btch: 31 usd: 100
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 110
CPU 23: hi: 186, btch: 31 usd: 92
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 116
CPU 1: hi: 186, btch: 31 usd: 174
CPU 2: hi: 186, btch: 31 usd: 180
CPU 3: hi: 186, btch: 31 usd: 145
CPU 4: hi: 186, btch: 31 usd: 170
CPU 5: hi: 186, btch: 31 usd: 62
CPU 6: hi: 186, btch: 31 usd: 107
CPU 7: hi: 186, btch: 31 usd: 158
CPU 8: hi: 186, btch: 31 usd: 167
CPU 9: hi: 186, btch: 31 usd: 154
CPU 10: hi: 186, btch: 31 usd: 135
CPU 11: hi: 186, btch: 31 usd: 187
CPU 12: hi: 186, btch: 31 usd: 139
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 15
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 0
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 174
CPU 19: hi: 186, btch: 31 usd: 115
CPU 20: hi: 186, btch: 31 usd: 163
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 113
CPU 23: hi: 186, btch: 31 usd: 81
active_anon:15111998 inactive_anon:875765 isolated_anon:0
active_file:261 inactive_file:290 isolated_file:96
unevictable:127243 dirty:0 writeback:0 unstable:0
free:42181 slab_reclaimable:5519 slab_unreclaimable:14505
mapped:6332 shmem:474 pagetables:36573 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122132kB min:980kB low:1224kB high:1468kB active_anon:1784996kB inactive_anon:51844kB active_file:20kB inactive_file:512kB unevictable:36kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:4kB writeback:0kB mapped:8kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:8kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:232 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14784kB min:15260kB low:19072kB high:22888kB active_anon:28337152kB inactive_anon:1667172kB active_file:824kB inactive_file:836kB unevictable:252132kB isolated(anon):0kB isolated(file):256kB present:31027200kB mlocked:55232kB dirty:0kB writeback:0kB mapped:11468kB shmem:772kB slab_reclaimable:11944kB slab_unreclaimable:36616kB kernel_stack:9784kB pagetables:69488kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2650 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15948kB min:16276kB low:20344kB high:24412kB active_anon:30325844kB inactive_anon:1784044kB active_file:200kB inactive_file:0kB unevictable:256804kB isolated(anon):0kB isolated(file):128kB present:33095680kB mlocked:11444kB dirty:8kB writeback:0kB mapped:13852kB shmem:1104kB slab_reclaimable:9908kB slab_unreclaimable:21024kB kernel_stack:6688kB pagetables:73184kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:420 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 317*4kB 200*8kB 118*16kB 64*32kB 38*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 122132kB
Node 0 Normal: 687*4kB 264*8kB 143*16kB 56*32kB 23*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 14892kB
Node 1 Normal: 519*4kB 126*8kB 39*16kB 45*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 15900kB
112821 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
27582 pages shared
16460591 pages non-shared
Out of memory: kill process 51590 (nrsysmond) score 5942 or a child
Killed process 51590 (nrsysmond) vsz:23768kB, anon-rss:156kB, file-rss:0kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 51212, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] ? delayacct_end+0x89/0xa0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 144
CPU 3: hi: 186, btch: 31 usd: 47
CPU 4: hi: 186, btch: 31 usd: 111
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 91
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 128
CPU 9: hi: 186, btch: 31 usd: 74
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 81
CPU 12: hi: 186, btch: 31 usd: 30
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 103
CPU 15: hi: 186, btch: 31 usd: 60
CPU 16: hi: 186, btch: 31 usd: 30
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 19
CPU 19: hi: 186, btch: 31 usd: 17
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 62
CPU 22: hi: 186, btch: 31 usd: 50
CPU 23: hi: 186, btch: 31 usd: 82
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 38
CPU 1: hi: 186, btch: 31 usd: 160
CPU 2: hi: 186, btch: 31 usd: 81
CPU 3: hi: 186, btch: 31 usd: 142
CPU 4: hi: 186, btch: 31 usd: 137
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 162
CPU 7: hi: 186, btch: 31 usd: 100
CPU 8: hi: 186, btch: 31 usd: 160
CPU 9: hi: 186, btch: 31 usd: 49
CPU 10: hi: 186, btch: 31 usd: 141
CPU 11: hi: 186, btch: 31 usd: 101
CPU 12: hi: 186, btch: 31 usd: 170
CPU 13: hi: 186, btch: 31 usd: 72
CPU 14: hi: 186, btch: 31 usd: 140
CPU 15: hi: 186, btch: 31 usd: 28
CPU 16: hi: 186, btch: 31 usd: 147
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 182
CPU 19: hi: 186, btch: 31 usd: 148
CPU 20: hi: 186, btch: 31 usd: 100
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 110
CPU 23: hi: 186, btch: 31 usd: 92
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 116
CPU 1: hi: 186, btch: 31 usd: 174
CPU 2: hi: 186, btch: 31 usd: 160
CPU 3: hi: 186, btch: 31 usd: 145
CPU 4: hi: 186, btch: 31 usd: 158
CPU 5: hi: 186, btch: 31 usd: 74
CPU 6: hi: 186, btch: 31 usd: 107
CPU 7: hi: 186, btch: 31 usd: 185
CPU 8: hi: 186, btch: 31 usd: 167
CPU 9: hi: 186, btch: 31 usd: 154
CPU 10: hi: 186, btch: 31 usd: 146
CPU 11: hi: 186, btch: 31 usd: 187
CPU 12: hi: 186, btch: 31 usd: 139
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 15
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 26
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 182
CPU 19: hi: 186, btch: 31 usd: 119
CPU 20: hi: 186, btch: 31 usd: 163
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 113
CPU 23: hi: 186, btch: 31 usd: 81
active_anon:15111976 inactive_anon:875759 isolated_anon:0
active_file:196 inactive_file:335 isolated_file:128
unevictable:127243 dirty:8 writeback:22 unstable:0
free:42111 slab_reclaimable:5519 slab_unreclaimable:14504
mapped:6389 shmem:474 pagetables:36536 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122008kB min:980kB low:1224kB high:1468kB active_anon:1784996kB inactive_anon:51844kB active_file:20kB inactive_file:588kB unevictable:36kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:4kB writeback:4kB mapped:84kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:8kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:232 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:14536kB min:15260kB low:19072kB high:22888kB active_anon:28337144kB inactive_anon:1667172kB active_file:692kB inactive_file:628kB unevictable:252132kB isolated(anon):0kB isolated(file):256kB present:31027200kB mlocked:55232kB dirty:16kB writeback:64kB mapped:11696kB shmem:772kB slab_reclaimable:11944kB slab_unreclaimable:36616kB kernel_stack:9784kB pagetables:69432kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2103 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:16040kB min:16276kB low:20344kB high:24412kB active_anon:30325764kB inactive_anon:1784020kB active_file:72kB inactive_file:124kB unevictable:256804kB isolated(anon):0kB isolated(file):256kB present:33095680kB mlocked:11444kB dirty:12kB writeback:20kB mapped:13776kB shmem:1104kB slab_reclaimable:9908kB slab_unreclaimable:21020kB kernel_stack:6688kB pagetables:73092kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1627 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 316*4kB 200*8kB 119*16kB 58*32kB 35*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 121760kB
Node 0 Normal: 718*4kB 262*8kB 142*16kB 56*32kB 23*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 14984kB
Node 1 Normal: 598*4kB 135*8kB 39*16kB 45*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16288kB
112658 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
26826 pages shared
16460724 pages non-shared
Out of memory: kill process 4713 (java) score 4617 or a child
Killed process 4713 (java) vsz:6501416kB, anon-rss:1160568kB, file-rss:1048kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 6398, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 144
CPU 3: hi: 186, btch: 31 usd: 47
CPU 4: hi: 186, btch: 31 usd: 111
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 91
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 128
CPU 9: hi: 186, btch: 31 usd: 74
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 81
CPU 12: hi: 186, btch: 31 usd: 30
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 103
CPU 15: hi: 186, btch: 31 usd: 60
CPU 16: hi: 186, btch: 31 usd: 30
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 19
CPU 19: hi: 186, btch: 31 usd: 17
CPU 20: hi: 186, btch: 31 usd: 0
CPU 21: hi: 186, btch: 31 usd: 62
CPU 22: hi: 186, btch: 31 usd: 50
CPU 23: hi: 186, btch: 31 usd: 82
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 38
CPU 1: hi: 186, btch: 31 usd: 164
CPU 2: hi: 186, btch: 31 usd: 96
CPU 3: hi: 186, btch: 31 usd: 142
CPU 4: hi: 186, btch: 31 usd: 169
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 165
CPU 7: hi: 186, btch: 31 usd: 100
CPU 8: hi: 186, btch: 31 usd: 160
CPU 9: hi: 186, btch: 31 usd: 49
CPU 10: hi: 186, btch: 31 usd: 141
CPU 11: hi: 186, btch: 31 usd: 101
CPU 12: hi: 186, btch: 31 usd: 170
CPU 13: hi: 186, btch: 31 usd: 73
CPU 14: hi: 186, btch: 31 usd: 157
CPU 15: hi: 186, btch: 31 usd: 28
CPU 16: hi: 186, btch: 31 usd: 147
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 155
CPU 19: hi: 186, btch: 31 usd: 148
CPU 20: hi: 186, btch: 31 usd: 100
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 110
CPU 23: hi: 186, btch: 31 usd: 92
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 116
CPU 1: hi: 186, btch: 31 usd: 174
CPU 2: hi: 186, btch: 31 usd: 160
CPU 3: hi: 186, btch: 31 usd: 145
CPU 4: hi: 186, btch: 31 usd: 158
CPU 5: hi: 186, btch: 31 usd: 74
CPU 6: hi: 186, btch: 31 usd: 107
CPU 7: hi: 186, btch: 31 usd: 185
CPU 8: hi: 186, btch: 31 usd: 167
CPU 9: hi: 186, btch: 31 usd: 154
CPU 10: hi: 186, btch: 31 usd: 146
CPU 11: hi: 186, btch: 31 usd: 187
CPU 12: hi: 186, btch: 31 usd: 139
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 15
CPU 15: hi: 186, btch: 31 usd: 0
CPU 16: hi: 186, btch: 31 usd: 26
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 182
CPU 19: hi: 186, btch: 31 usd: 119
CPU 20: hi: 186, btch: 31 usd: 163
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 113
CPU 23: hi: 186, btch: 31 usd: 81
active_anon:15111976 inactive_anon:875759 isolated_anon:0
active_file:102 inactive_file:380 isolated_file:128
unevictable:127243 dirty:10 writeback:0 unstable:0
free:42266 slab_reclaimable:5519 slab_unreclaimable:14504
mapped:6377 shmem:474 pagetables:36536 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:122008kB min:980kB low:1224kB high:1468kB active_anon:1784996kB inactive_anon:51844kB active_file:20kB inactive_file:588kB unevictable:36kB isolated(anon):0kB isolated(file):0kB present:1993952kB mlocked:0kB dirty:4kB writeback:4kB mapped:84kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:8kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:232 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:15156kB min:15260kB low:19072kB high:22888kB active_anon:28337144kB inactive_anon:1667172kB active_file:316kB inactive_file:776kB unevictable:252132kB isolated(anon):0kB isolated(file):256kB present:31027200kB mlocked:55232kB dirty:16kB writeback:0kB mapped:11640kB shmem:772kB slab_reclaimable:11944kB slab_unreclaimable:36616kB kernel_stack:9784kB pagetables:69432kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1698 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:16040kB min:16276kB low:20344kB high:24412kB active_anon:30325764kB inactive_anon:1784020kB active_file:72kB inactive_file:156kB unevictable:256804kB isolated(anon):0kB isolated(file):256kB present:33095680kB mlocked:11444kB dirty:20kB writeback:20kB mapped:13784kB shmem:1104kB slab_reclaimable:9908kB slab_unreclaimable:21020kB kernel_stack:6688kB pagetables:73092kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1627 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 316*4kB 200*8kB 119*16kB 58*32kB 35*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 121760kB
Node 0 Normal: 749*4kB 263*8kB 142*16kB 56*32kB 23*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 15116kB
Node 1 Normal: 598*4kB 135*8kB 39*16kB 45*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16288kB
112607 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
26706 pages shared
16460683 pages non-shared
Out of memory: kill process 4493 (java) score 4232 or a child
Killed process 4493 (java) vsz:6501416kB, anon-rss:1163124kB, file-rss:656kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 6398, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 176
CPU 3: hi: 186, btch: 31 usd: 47
CPU 4: hi: 186, btch: 31 usd: 143
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 125
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 128
CPU 9: hi: 186, btch: 31 usd: 74
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 81
CPU 12: hi: 186, btch: 31 usd: 30
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 103
CPU 15: hi: 186, btch: 31 usd: 92
CPU 16: hi: 186, btch: 31 usd: 62
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 19
CPU 19: hi: 186, btch: 31 usd: 17
CPU 20: hi: 186, btch: 31 usd: 92
CPU 21: hi: 186, btch: 31 usd: 62
CPU 22: hi: 186, btch: 31 usd: 50
CPU 23: hi: 186, btch: 31 usd: 51
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 38
CPU 1: hi: 186, btch: 31 usd: 164
CPU 2: hi: 186, btch: 31 usd: 96
CPU 3: hi: 186, btch: 31 usd: 142
CPU 4: hi: 186, btch: 31 usd: 169
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 165
CPU 7: hi: 186, btch: 31 usd: 100
CPU 8: hi: 186, btch: 31 usd: 160
CPU 9: hi: 186, btch: 31 usd: 49
CPU 10: hi: 186, btch: 31 usd: 141
CPU 11: hi: 186, btch: 31 usd: 101
CPU 12: hi: 186, btch: 31 usd: 170
CPU 13: hi: 186, btch: 31 usd: 73
CPU 14: hi: 186, btch: 31 usd: 157
CPU 15: hi: 186, btch: 31 usd: 28
CPU 16: hi: 186, btch: 31 usd: 147
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 155
CPU 19: hi: 186, btch: 31 usd: 148
CPU 20: hi: 186, btch: 31 usd: 100
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 110
CPU 23: hi: 186, btch: 31 usd: 92
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 116
CPU 1: hi: 186, btch: 31 usd: 174
CPU 2: hi: 186, btch: 31 usd: 160
CPU 3: hi: 186, btch: 31 usd: 145
CPU 4: hi: 186, btch: 31 usd: 158
CPU 5: hi: 186, btch: 31 usd: 74
CPU 6: hi: 186, btch: 31 usd: 139
CPU 7: hi: 186, btch: 31 usd: 170
CPU 8: hi: 186, btch: 31 usd: 179
CPU 9: hi: 186, btch: 31 usd: 155
CPU 10: hi: 186, btch: 31 usd: 181
CPU 11: hi: 186, btch: 31 usd: 187
CPU 12: hi: 186, btch: 31 usd: 139
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 15
CPU 15: hi: 186, btch: 31 usd: 2
CPU 16: hi: 186, btch: 31 usd: 37
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 182
CPU 19: hi: 186, btch: 31 usd: 136
CPU 20: hi: 186, btch: 31 usd: 163
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 107
CPU 23: hi: 186, btch: 31 usd: 81
active_anon:15111711 inactive_anon:876015 isolated_anon:0
active_file:16 inactive_file:476 isolated_file:115
unevictable:127243 dirty:23 writeback:0 unstable:0
free:42165 slab_reclaimable:5518 slab_unreclaimable:14508
mapped:6340 shmem:474 pagetables:36524 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:121760kB min:980kB low:1224kB high:1468kB active_anon:1783972kB inactive_anon:52868kB active_file:20kB inactive_file:400kB unevictable:36kB isolated(anon):0kB isolated(file):128kB present:1993952kB mlocked:0kB dirty:20kB writeback:28kB mapped:104kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:8kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:571 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:15124kB min:15260kB low:19072kB high:22888kB active_anon:28337108kB inactive_anon:1667172kB active_file:44kB inactive_file:808kB unevictable:252132kB isolated(anon):0kB isolated(file):76kB present:31027200kB mlocked:55232kB dirty:64kB writeback:0kB mapped:11484kB shmem:772kB slab_reclaimable:11940kB slab_unreclaimable:36632kB kernel_stack:9784kB pagetables:69388kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3575 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15916kB min:16276kB low:20344kB high:24412kB active_anon:30325764kB inactive_anon:1784020kB active_file:0kB inactive_file:696kB unevictable:256804kB isolated(anon):0kB isolated(file):256kB present:33095680kB mlocked:11444kB dirty:8kB writeback:36kB mapped:13772kB shmem:1104kB slab_reclaimable:9908kB slab_unreclaimable:21020kB kernel_stack:6688kB pagetables:73088kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:10586 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 343*4kB 202*8kB 119*16kB 58*32kB 35*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 121884kB
Node 0 Normal: 749*4kB 264*8kB 142*16kB 56*32kB 23*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 15124kB
Node 1 Normal: 551*4kB 139*8kB 41*16kB 45*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16164kB
112520 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
26524 pages shared
16460458 pages non-shared
Out of memory: kill process 4528 (java) score 4232 or a child
Killed process 4528 (java) vsz:6501416kB, anon-rss:1176660kB, file-rss:860kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 6398, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 176
CPU 3: hi: 186, btch: 31 usd: 47
CPU 4: hi: 186, btch: 31 usd: 143
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 125
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 128
CPU 9: hi: 186, btch: 31 usd: 74
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 81
CPU 12: hi: 186, btch: 31 usd: 30
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 103
CPU 15: hi: 186, btch: 31 usd: 92
CPU 16: hi: 186, btch: 31 usd: 62
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 19
CPU 19: hi: 186, btch: 31 usd: 17
CPU 20: hi: 186, btch: 31 usd: 92
CPU 21: hi: 186, btch: 31 usd: 62
CPU 22: hi: 186, btch: 31 usd: 50
CPU 23: hi: 186, btch: 31 usd: 51
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 38
CPU 1: hi: 186, btch: 31 usd: 164
CPU 2: hi: 186, btch: 31 usd: 96
CPU 3: hi: 186, btch: 31 usd: 142
CPU 4: hi: 186, btch: 31 usd: 169
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 165
CPU 7: hi: 186, btch: 31 usd: 100
CPU 8: hi: 186, btch: 31 usd: 160
CPU 9: hi: 186, btch: 31 usd: 49
CPU 10: hi: 186, btch: 31 usd: 141
CPU 11: hi: 186, btch: 31 usd: 101
CPU 12: hi: 186, btch: 31 usd: 170
CPU 13: hi: 186, btch: 31 usd: 73
CPU 14: hi: 186, btch: 31 usd: 157
CPU 15: hi: 186, btch: 31 usd: 28
CPU 16: hi: 186, btch: 31 usd: 147
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 155
CPU 19: hi: 186, btch: 31 usd: 148
CPU 20: hi: 186, btch: 31 usd: 100
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 110
CPU 23: hi: 186, btch: 31 usd: 92
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 116
CPU 1: hi: 186, btch: 31 usd: 174
CPU 2: hi: 186, btch: 31 usd: 160
CPU 3: hi: 186, btch: 31 usd: 145
CPU 4: hi: 186, btch: 31 usd: 158
CPU 5: hi: 186, btch: 31 usd: 74
CPU 6: hi: 186, btch: 31 usd: 139
CPU 7: hi: 186, btch: 31 usd: 170
CPU 8: hi: 186, btch: 31 usd: 179
CPU 9: hi: 186, btch: 31 usd: 155
CPU 10: hi: 186, btch: 31 usd: 181
CPU 11: hi: 186, btch: 31 usd: 187
CPU 12: hi: 186, btch: 31 usd: 139
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 15
CPU 15: hi: 186, btch: 31 usd: 2
CPU 16: hi: 186, btch: 31 usd: 37
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 182
CPU 19: hi: 186, btch: 31 usd: 136
CPU 20: hi: 186, btch: 31 usd: 163
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 107
CPU 23: hi: 186, btch: 31 usd: 81
active_anon:15111711 inactive_anon:876015 isolated_anon:0
active_file:3 inactive_file:479 isolated_file:96
unevictable:127243 dirty:37 writeback:0 unstable:0
free:42167 slab_reclaimable:5518 slab_unreclaimable:14506
mapped:6319 shmem:474 pagetables:36524 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:121760kB min:980kB low:1224kB high:1468kB active_anon:1783972kB inactive_anon:52868kB active_file:20kB inactive_file:520kB unevictable:36kB isolated(anon):0kB isolated(file):128kB present:1993952kB mlocked:0kB dirty:36kB writeback:28kB mapped:108kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:8kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:571 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:15132kB min:15260kB low:19072kB high:22888kB active_anon:28337108kB inactive_anon:1667172kB active_file:0kB inactive_file:824kB unevictable:252132kB isolated(anon):0kB isolated(file):0kB present:31027200kB mlocked:55232kB dirty:88kB writeback:0kB mapped:11404kB shmem:772kB slab_reclaimable:11940kB slab_unreclaimable:36624kB kernel_stack:9784kB pagetables:69388kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3575 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:15916kB min:16276kB low:20344kB high:24412kB active_anon:30325764kB inactive_anon:1784020kB active_file:0kB inactive_file:572kB unevictable:256804kB isolated(anon):0kB isolated(file):256kB present:33095680kB mlocked:11444kB dirty:24kB writeback:36kB mapped:13764kB shmem:1104kB slab_reclaimable:9908kB slab_unreclaimable:21020kB kernel_stack:6688kB pagetables:73088kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:10586 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 343*4kB 202*8kB 119*16kB 58*32kB 35*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 121884kB
Node 0 Normal: 749*4kB 264*8kB 142*16kB 56*32kB 23*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 15124kB
Node 1 Normal: 551*4kB 139*8kB 41*16kB 45*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16164kB
112472 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
26532 pages shared
16460458 pages non-shared
Out of memory: kill process 4862 (java) score 4232 or a child
Killed process 4862 (java) vsz:6501416kB, anon-rss:1171336kB, file-rss:660kB
java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
java cpuset=/ mems_allowed=0-1
Pid: 6398, comm: java Tainted: G M D 2.6.35-22-server #33-Ubuntu
Call Trace:
[] ? cpuset_print_task_mems_allowed+0x9d/0xb0
[] dump_header+0x81/0xc0
[] oom_kill_process+0x81/0x180
[] __out_of_memory+0x58/0xd0
[] out_of_memory+0x86/0x1c0
[] __alloc_pages_slowpath+0x526/0x590
[] __alloc_pages_nodemask+0x164/0x1d0
[] alloc_pages_current+0x9a/0x100
[] __page_cache_alloc+0x87/0x90
[] __do_page_cache_readahead+0xc9/0x210
[] ra_submit+0x21/0x30
[] filemap_fault+0x3f3/0x450
[] __do_fault+0x54/0x560
[] handle_mm_fault+0x1b9/0x440
[] do_page_fault+0x125/0x350
[] page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
CPU 8: hi: 0, btch: 1 usd: 0
CPU 9: hi: 0, btch: 1 usd: 0
CPU 10: hi: 0, btch: 1 usd: 0
CPU 11: hi: 0, btch: 1 usd: 0
CPU 12: hi: 0, btch: 1 usd: 0
CPU 13: hi: 0, btch: 1 usd: 0
CPU 14: hi: 0, btch: 1 usd: 0
CPU 15: hi: 0, btch: 1 usd: 0
CPU 16: hi: 0, btch: 1 usd: 0
CPU 17: hi: 0, btch: 1 usd: 0
CPU 18: hi: 0, btch: 1 usd: 0
CPU 19: hi: 0, btch: 1 usd: 0
CPU 20: hi: 0, btch: 1 usd: 0
CPU 21: hi: 0, btch: 1 usd: 0
CPU 22: hi: 0, btch: 1 usd: 0
CPU 23: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 168
CPU 2: hi: 186, btch: 31 usd: 176
CPU 3: hi: 186, btch: 31 usd: 47
CPU 4: hi: 186, btch: 31 usd: 143
CPU 5: hi: 186, btch: 31 usd: 149
CPU 6: hi: 186, btch: 31 usd: 125
CPU 7: hi: 186, btch: 31 usd: 24
CPU 8: hi: 186, btch: 31 usd: 128
CPU 9: hi: 186, btch: 31 usd: 74
CPU 10: hi: 186, btch: 31 usd: 34
CPU 11: hi: 186, btch: 31 usd: 81
CPU 12: hi: 186, btch: 31 usd: 30
CPU 13: hi: 186, btch: 31 usd: 53
CPU 14: hi: 186, btch: 31 usd: 103
CPU 15: hi: 186, btch: 31 usd: 92
CPU 16: hi: 186, btch: 31 usd: 62
CPU 17: hi: 186, btch: 31 usd: 1
CPU 18: hi: 186, btch: 31 usd: 19
CPU 19: hi: 186, btch: 31 usd: 17
CPU 20: hi: 186, btch: 31 usd: 92
CPU 21: hi: 186, btch: 31 usd: 62
CPU 22: hi: 186, btch: 31 usd: 50
CPU 23: hi: 186, btch: 31 usd: 51
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 38
CPU 1: hi: 186, btch: 31 usd: 164
CPU 2: hi: 186, btch: 31 usd: 96
CPU 3: hi: 186, btch: 31 usd: 142
CPU 4: hi: 186, btch: 31 usd: 169
CPU 5: hi: 186, btch: 31 usd: 164
CPU 6: hi: 186, btch: 31 usd: 165
CPU 7: hi: 186, btch: 31 usd: 100
CPU 8: hi: 186, btch: 31 usd: 160
CPU 9: hi: 186, btch: 31 usd: 49
CPU 10: hi: 186, btch: 31 usd: 141
CPU 11: hi: 186, btch: 31 usd: 101
CPU 12: hi: 186, btch: 31 usd: 170
CPU 13: hi: 186, btch: 31 usd: 73
CPU 14: hi: 186, btch: 31 usd: 157
CPU 15: hi: 186, btch: 31 usd: 28
CPU 16: hi: 186, btch: 31 usd: 147
CPU 17: hi: 186, btch: 31 usd: 109
CPU 18: hi: 186, btch: 31 usd: 155
CPU 19: hi: 186, btch: 31 usd: 148
CPU 20: hi: 186, btch: 31 usd: 100
CPU 21: hi: 186, btch: 31 usd: 0
CPU 22: hi: 186, btch: 31 usd: 110
CPU 23: hi: 186, btch: 31 usd: 92
Node 1 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 116
CPU 1: hi: 186, btch: 31 usd: 174
CPU 2: hi: 186, btch: 31 usd: 160
CPU 3: hi: 186, btch: 31 usd: 145
CPU 4: hi: 186, btch: 31 usd: 158
CPU 5: hi: 186, btch: 31 usd: 74
CPU 6: hi: 186, btch: 31 usd: 139
CPU 7: hi: 186, btch: 31 usd: 170
CPU 8: hi: 186, btch: 31 usd: 179
CPU 9: hi: 186, btch: 31 usd: 155
CPU 10: hi: 186, btch: 31 usd: 181
CPU 11: hi: 186, btch: 31 usd: 187
CPU 12: hi: 186, btch: 31 usd: 139
CPU 13: hi: 186, btch: 31 usd: 0
CPU 14: hi: 186, btch: 31 usd: 15
CPU 15: hi: 186, btch: 31 usd: 2
CPU 16: hi: 186, btch: 31 usd: 37
CPU 17: hi: 186, btch: 31 usd: 14
CPU 18: hi: 186, btch: 31 usd: 182
CPU 19: hi: 186, btch: 31 usd: 136
CPU 20: hi: 186, btch: 31 usd: 163
CPU 21: hi: 186, btch: 31 usd: 174
CPU 22: hi: 186, btch: 31 usd: 107
CPU 23: hi: 186, btch: 31 usd: 81
active_anon:15111679 inactive_anon:876047 isolated_anon:0
active_file:98 inactive_file:115 isolated_file:160
unevictable:127243 dirty:1 writeback:0 unstable:0
free:42225 slab_reclaimable:5517 slab_unreclaimable:14510
mapped:6297 shmem:474 pagetables:36524 bounce:0
Node 0 DMA free:15860kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 1947 32247 32247
Node 0 DMA32 free:121760kB min:980kB low:1224kB high:1468kB active_anon:1783844kB inactive_anon:52996kB active_file:20kB inactive_file:128kB unevictable:36kB isolated(anon):0kB isolated(file):256kB present:1993952kB mlocked:0kB dirty:4kB writeback:60kB mapped:72kB shmem:20kB slab_reclaimable:224kB slab_unreclaimable:380kB kernel_stack:8kB pagetables:3620kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:571 all_unreclaimable? yes
lowmem_reserve[]: 0 0 30300 30300
Node 0 Normal free:15116kB min:15260kB low:19072kB high:22888kB active_anon:28337108kB inactive_anon:1667172kB active_file:296kB inactive_file:256kB unevictable:252132kB isolated(anon):0kB isolated(file):128kB present:31027200kB mlocked:55232kB dirty:0kB writeback:0kB mapped:11360kB shmem:772kB slab_reclaimable:11936kB slab_unreclaimable:36640kB kernel_stack:9784kB pagetables:69388kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3575 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 1 Normal free:16164kB min:16276kB low:20344kB high:24412kB active_anon:30325764kB inactive_anon:1784020kB active_file:76kB inactive_file:76kB unevictable:256804kB isolated(anon):0kB isolated(file):256kB present:33095680kB mlocked:11444kB dirty:0kB writeback:84kB mapped:13756kB shmem:1104kB slab_reclaimable:9908kB slab_unreclaimable:21020kB kernel_stack:6688kB pagetables:73088kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:10586 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 2*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15860kB
Node 0 DMA32: 343*4kB 202*8kB 119*16kB 58*32kB 35*64kB 18*128kB 14*256kB 5*512kB 4*1024kB 3*2048kB 23*4096kB = 121884kB
Node 0 Normal: 749*4kB 264*8kB 142*16kB 56*32kB 23*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 15124kB
Node 1 Normal: 551*4kB 139*8kB 41*16kB 45*32kB 16*64kB 12*128kB 8*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 16164kB
112226 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
16777200 pages RAM
258103 pages reserved
26535 pages shared
16460458 pages non-shared
Out of memory: kill process 4899 (java) score 4232 or a child
Killed process 4899 (java) vsz:6501416kB, anon-rss:1176476kB, file-rss:944kB
Out of memory: kill process 5073 (java) score 4232 or a child
Killed process 5073 (java) vsz:6501416kB, anon-rss:1190688kB, file-rss:1072kB
Out of memory: kill process 2473 (ntpd) score 3983 or a child
Killed process 2473 (ntpd) vsz:31864kB, anon-rss:616kB, file-rss:680kB
init: rsyslog main process (7844) killed by KILL signal
init: rsyslog main process ended, respawning
BUG: soft lockup - CPU#0 stuck for 61s! [kacpi_notify:156]
Modules linked in: ipmi_devintf ipmi_si ipmi_msghandler sco bnep rfcomm l2cap bluetooth dcdbas joydev shpchp hed coretemp lp parport dm_raid45 usbhid ahci libahci igb hid dca xor
CPU 0
Modules linked in: ipmi_devintf ipmi_si ipmi_msghandler sco bnep rfcomm l2cap bluetooth dcdbas joydev shpchp hed coretemp lp parport dm_raid45 usbhid ahci libahci igb hid dca xor
Pid: 156, comm: kacpi_notify Tainted: G M D 2.6.35-22-server #33-Ubuntu 0TTH1R/PowerEdge C8220
RIP: 0010:[] [] generic_exec_single+0x86/0xb0
RSP: 0000:ffff88085c543ae0 EFLAGS: 00000202
RAX: 0000000000000040 RBX: ffff88085c543b20 RCX: 0000000000000012
RDX: 0000000000000040 RSI: 0000000000000040 RDI: 0000000000000282
RBP: ffffffff8100aa8e R08: ffffffff8160b9d8 R09: 0000000000000040
R10: ffff88085b60b4c0 R11: 0000000000000001 R12: 0000000000000001
R13: ffff88085ac11400 R14: 0000000000000000 R15: ffff88085ac11400
FS: 0000000000000000(0000) GS:ffff880001e00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fe7e410ed78 CR3: 0000000001a2a000 CR4: 00000000000406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kacpi_notify (pid: 156, threadinfo ffff88085c542000, task ffff88085c5396e0)
Stack:
ffff88085c543b00 ffff880001f763c0 0000000000000286 0000000000000011
ffffffff81026860 0000000000000000 ffffffff81ae66c8 ffffffff81bfcb60
ffff88085c543b90 ffffffff81094ed2 000000035c543b80 54534f5f00000000
Call Trace:
[] ? do_drv_read+0x0/0x50
[] ? smp_call_function_single+0x152/0x160
[] ? do_drv_read+0x0/0x50
[] ? do_drv_read+0x0/0x50
[] ? smp_call_function_any+0x52/0x110
[] ? get_cur_val+0xaf/0x100
[] ? get_cur_freq_on_cpu+0x59/0x80
[] ? cpufreq_update_policy+0x96/0xf0
[] ? handle_update+0x0/0x20
[] ? acpi_processor_ppc_has_changed+0x71/0x78
[] ? acpi_processor_notify+0x55/0x115
[] ? acpi_os_execute_deferred+0x0/0x36
[] ? acpi_device_notify+0x19/0x1b
[] ? acpi_ev_notify_dispatch+0x67/0x7e
[] ? acpi_os_execute_deferred+0x29/0x36
[] ? run_workqueue+0xc5/0x1a0
[] ? worker_thread+0xa3/0x110
[] ? autoremove_wake_function+0x0/0x40
[] ? worker_thread+0x0/0x110
[] ? kthread+0x96/0xa0
[] ? kernel_thread_helper+0x4/0x10
[] ? kthread+0x0/0xa0
[] ? kernel_thread_helper+0x0/0x10
Code: 89 5d 08 4c 89 2b 48 89 53 08 48 89 1a e8 53 9b 50 00 4c 3b 6d c8 74 2b 45 85 ff 75 0a eb 0e eb 04 90 90 90 90 f3 90 f6 43 20 01 f8 48 8b 5d d8 4c 8b 65 e0 4c 8b 6d e8 4c 8b 75 f0 4c 8b 7d
Call Trace:
[] ? do_drv_read+0x0/0x50
[] ? smp_call_function_single+0x152/0x160
[] ? do_drv_read+0x0/0x50
[] ? do_drv_read+0x0/0x50
[] ? smp_call_function_any+0x52/0x110
[] ? get_cur_val+0xaf/0x100
[] ? get_cur_freq_on_cpu+0x59/0x80
[] ? cpufreq_update_policy+0x96/0xf0
[] ? handle_update+0x0/0x20
[] ? acpi_processor_ppc_has_changed+0x71/0x78
[] ? acpi_processor_notify+0x55/0x115
[] ? acpi_os_execute_deferred+0x0/0x36
[] ? acpi_device_notify+0x19/0x1b
[] ? acpi_ev_notify_dispatch+0x67/0x7e
[] ? acpi_os_execute_deferred+0x29/0x36
[] ? run_workqueue+0xc5/0x1a0
[] ? worker_thread+0xa3/0x110
[] ? autoremove_wake_function+0x0/0x40
[] ? worker_thread+0x0/0x110
[] ? kthread+0x96/0xa0
[] ? kernel_thread_helper+0x4/0x10
[] ? kthread+0x0/0xa0
[] ? kernel_thread_helper+0x0/0x10
BUG: soft lockup - CPU#0 stuck for 61s! [kacpi_notify:156]
Modules linked in: ipmi_devintf ipmi_si ipmi_msghandler sco bnep rfcomm l2cap bluetooth dcdbas joydev shpchp hed coretemp lp parport dm_raid45 usbhid ahci libahci igb hid dca xor
CPU 0
Modules linked in: ipmi_devintf ipmi_si ipmi_msghandler sco bnep rfcomm l2cap bluetooth dcdbas joydev shpchp hed coretemp lp parport dm_raid45 usbhid ahci libahci igb hid dca xor
Pid: 156, comm: kacpi_notify Tainted: G M D 2.6.35-22-server #33-Ubuntu 0TTH1R/PowerEdge C8220
RIP: 0010:[] [] generic_exec_single+0x86/0xb0
RSP: 0000:ffff88085c543ae0 EFLAGS: 00000202
RAX: 0000000000000040 RBX: ffff88085c543b20 RCX: 0000000000000012
RDX: 0000000000000040 RSI: 0000000000000040 RDI: 0000000000000282
RBP: ffffffff8100aa8e R08: ffffffff8160b9d8 R09: 0000000000000040
R10: ffff88085b60b4c0 R11: 0000000000000001 R12: 0000000000000001
R13: ffff88085ac11400 R14: 0000000000000000 R15: ffff88085ac11400
FS: 0000000000000000(0000) GS:ffff880001e00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fe7e410ed78 CR3: 0000000001a2a000 CR4: 00000000000406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kacpi_notify (pid: 156, threadinfo ffff88085c542000, task ffff88085c5396e0)
Stack:
ffff88085c543b00 ffff880001f763c0 0000000000000286 0000000000000011
ffffffff81026860 0000000000000000 ffffffff81ae66c8 ffffffff81bfcb60
ffff88085c543b90 ffffffff81094ed2 000000035c543b80 54534f5f00000000
Call Trace:
[] ? do_drv_read+0x0/0x50
[] ? smp_call_function_single+0x152/0x160
[] ? do_drv_read+0x0/0x50
[] ? do_drv_read+0x0/0x50
[] ? smp_call_function_any+0x52/0x110
[] ? get_cur_val+0xaf/0x100
[] ? get_cur_freq_on_cpu+0x59/0x80
[] ? cpufreq_update_policy+0x96/0xf0
[] ? handle_update+0x0/0x20
[] ? acpi_processor_ppc_has_changed+0x71/0x78
[] ? acpi_processor_notify+0x55/0x115
[] ? acpi_os_execute_deferred+0x0/0x36
[] ? acpi_device_notify+0x19/0x1b
[] ? acpi_ev_notify_dispatch+0x67/0x7e
[] ? acpi_os_execute_deferred+0x29/0x36
[] ? run_workqueue+0xc5/0x1a0
[] ? worker_thread+0xa3/0x110
[] ? autoremove_wake_function+0x0/0x40
[] ? worker_thread+0x0/0x110
[] ? kthread+0x96/0xa0
[] ? kernel_thread_helper+0x4/0x10
[] ? kthread+0x0/0xa0
[] ? kernel_thread_helper+0x0/0x10
Code: 89 5d 08 4c 89 2b 48 89 53 08 48 89 1a e8 53 9b 50 00 4c 3b 6d c8 74 2b 45 85 ff 75 0a eb 0e eb 04 90 90 90 90 f3 90 f6 43 20 01 f8 48 8b 5d d8 4c 8b 65 e0 4c 8b 6d e8 4c 8b 75 f0 4c 8b 7d
Call Trace:
[] ? do_drv_read+0x0/0x50
[] ? smp_call_function_single+0x152/0x160
[] ? do_drv_read+0x0/0x50
[] ? do_drv_read+0x0/0x50
[] ? smp_call_function_any+0x52/0x110
[] ? get_cur_val+0xaf/0x100
[] ? get_cur_freq_on_cpu+0x59/0x80
[] ? cpufreq_update_policy+0x96/0xf0
[] ? handle_update+0x0/0x20
[] ? acpi_processor_ppc_has_changed+0x71/0x78
[] ? acpi_processor_notify+0x55/0x115
[] ? acpi_os_execute_deferred+0x0/0x36
[] ? acpi_device_notify+0x19/0x1b
[] ? acpi_ev_notify_dispatch+0x67/0x7e
[] ? acpi_os_execute_deferred+0x29/0x36
[] ? run_workqueue+0xc5/0x1a0
[] ? worker_thread+0xa3/0x110
[] ? autoremove_wake_function+0x0/0x40
[] ? worker_thread+0x0/0x110
[] ? kthread+0x96/0xa0
[] ? kernel_thread_helper+0x4/0x10
[] ? kthread+0x0/0xa0
[] ? kernel_thread_helper+0x0/0x10
BUG: soft lockup - CPU#17 stuck for 131s! [events/17:92]
Modules linked in: ipmi_devintf ipmi_si ipmi_msghandler sco bnep rfcomm l2cap bluetooth dcdbas joydev shpchp hed coretemp lp parport dm_raid45 usbhid ahci libahci igb hid dca xor
CPU 17
Modules linked in: ipmi_devintf ipmi_si ipmi_msghandler sco bnep rfcomm l2cap bluetooth dcdbas joydev shpchp hed coretemp lp parport dm_raid45 usbhid ahci libahci igb hid dca xor
Pid: 92, comm: events/17 Tainted: G M D 2.6.35-22-server #33-Ubuntu 0TTH1R/PowerEdge C8220
RIP: 0010:[] [] release_console_sem+0x53/0x210
RSP: 0018:ffff88085cb91d70 EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff88085cb91db0 RCX: 0000000000000000
RDX: 00000000ffffffff RSI: 000000000008f2f1 RDI: 0000000000000286
RBP: ffffffff8100aa8e R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000005000 R12: ffff880000000e20
R13: 01ffffff81036dc9 R14: ffff880800000005 R15: ffffffff00000004
FS: 0000000000000000(0000) GS:ffff880001f60000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fe75bb8a4f0 CR3: 0000000001a2a000 CR4: 00000000000406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process events/17 (pid: 92, threadinfo ffff88085cb90000, task ffff88085cb82dc0)
Stack:
ffff88085cb91da0 ffffffff8108449e ffff88085cb91db0 ffff88087fc18000
ffff88105a704000 0000000000000e20 0000000000000000 0000000000000002
ffff88085cb91e00 ffffffff812fc2aa ffff880001f78bc0 ffffffff81302760
Call Trace:
[] ? down+0x2e/0x50
[] ? fb_flashcursor+0x6a/0x120
[] ? bit_cursor+0x0/0x6c0
[] ? fb_flashcursor+0x0/0x120
[] ? run_workqueue+0xc5/0x1a0
[] ? worker_thread+0xa3/0x110
[] ? autoremove_wake_function+0x0/0x40
[] ? worker_thread+0x0/0x110
[] ? kthread+0x96/0xa0
[] ? kernel_thread_helper+0x4/0x10
[] ? kthread+0x0/0xa0
[] ? kernel_thread_helper+0x0/0x10
Code: d0 d2 b9 00 00 00 00 00 45 31 f6 49 c7 c7 70 e1 bf 81 eb 1c eb 02 90 90 8b 15 b2 ac 9d 00 44 89 e6 e8 72 fb ff ff 4c 89 ef 57 9d 1f 44 00 00 48 c7 c7 70 e1 bf 81 e8 bc d7 53 00 44 8b 25 c5
Call Trace:
[] ? down+0x2e/0x50
[] ? fb_flashcursor+0x6a/0x120
[] ? bit_cursor+0x0/0x6c0
[] ? fb_flashcursor+0x0/0x120
[] ? run_workqueue+0xc5/0x1a0
[] ? worker_thread+0xa3/0x110
[] ? autoremove_wake_function+0x0/0x40
[] ? worker_thread+0x0/0x110
[] ? kthread+0x96/0xa0
[] ? kernel_thread_helper+0x4/0x10
[] ? kthread+0x0/0xa0
[] ? kernel_thread_helper+0x0/0x10
Clocksource tsc unstable (delta = 149061016 ns)
Switching to clocksource hpet
init: whoopsie main process (7907) killed by KILL signal
init: whoopsie main process ended, respawning
CPU10: Core power limit normal
CPU11: Core power limit normal
CPU22: Core power limit normal
CPU9: Core power limit normal
CPU21: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU23: Core power limit normal
CPU18: Core power limit normal
CPU6: Core power limit normal
CPU7: Core power limit normal
CPU19: Core power limit normal
CPU11: Package power limit normal
CPU22: Package power limit normal
CPU9: Package power limit normal
CPU21: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU23: Package power limit normal
CPU18: Package power limit normal
CPU6: Package power limit normal
CPU7: Package power limit normal
CPU19: Package power limit normal
CPU10: Package power limit notification (total events = 55272)
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU16: Core power limit normal
CPU4: Core power limit normal
CPU13: Core power limit normal
CPU15: Core power limit normal
CPU3: Core power limit normal
CPU1: Core power limit normal
CPU14: Core power limit normal
CPU2: Core power limit normal
CPU0: Package power limit normal
CPU5: Package power limit normal
CPU17: Package power limit normal
CPU16: Package power limit normal
CPU4: Package power limit normal
CPU13: Package power limit normal
CPU15: Package power limit normal
CPU3: Package power limit normal
CPU1: Package power limit normal
CPU14: Package power limit normal
CPU2: Package power limit normal
CPU12: Package power limit notification (total events = 51562)
CPU10: Core power limit normal
CPU21: Core power limit normal
CPU11: Core power limit normal
CPU9: Core power limit normal
CPU22: Core power limit normal
CPU20: Core power limit normal
CPU8: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU23: Core power limit normal
CPU19: Core power limit normal
CPU7: Core power limit normal
CPU21: Package power limit normal
CPU11: Package power limit normal
CPU9: Package power limit normal
CPU22: Package power limit normal
CPU20: Package power limit normal
CPU8: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU23: Package power limit normal
CPU19: Package power limit normal
CPU7: Package power limit normal
CPU10: Package power limit notification (total events = 55286)
CPU3: Core power limit normal
CPU15: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU1: Core power limit normal
CPU2: Core power limit normal
CPU14: Core power limit normal
CPU17: Core power limit normal
CPU16: Core power limit normal
CPU4: Core power limit normal
CPU5: Core power limit normal
CPU13: Core power limit normal
CPU15: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU1: Package power limit normal
CPU2: Package power limit normal
CPU14: Package power limit normal
CPU17: Package power limit normal
CPU16: Package power limit normal
CPU4: Package power limit normal
CPU5: Package power limit normal
CPU13: Package power limit normal
CPU3: Package power limit notification (total events = 51499)
CPU21: Core power limit normal
CPU19: Core power limit normal
CPU7: Core power limit normal
CPU9: Core power limit normal
CPU18: Core power limit normal
CPU6: Core power limit normal
CPU22: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU10: Core power limit normal
CPU19: Package power limit normal
CPU7: Package power limit normal
CPU9: Package power limit normal
CPU18: Package power limit normal
CPU6: Package power limit normal
CPU22: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU10: Package power limit normal
CPU21: Package power limit notification (total events = 55516)
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU14: Core power limit normal
CPU3: Core power limit normal
CPU2: Core power limit normal
CPU15: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU1: Core power limit normal
CPU13: Core power limit normal
CPU17: Package power limit normal
CPU4: Package power limit normal
CPU16: Package power limit normal
CPU14: Package power limit normal
CPU3: Package power limit normal
CPU2: Package power limit normal
CPU15: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU1: Package power limit normal
CPU13: Package power limit normal
CPU5: Package power limit notification (total events = 51439)
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU21: Core power limit normal
CPU9: Core power limit normal
CPU7: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU19: Core power limit normal
CPU6: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU18: Core power limit normal
CPU11: Package power limit normal
CPU21: Package power limit normal
CPU9: Package power limit normal
CPU7: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU19: Package power limit normal
CPU6: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU18: Package power limit normal
CPU23: Package power limit notification (total events = 55217)
CPU15: Core power limit normal
CPU5: Core power limit normal
CPU16: Core power limit normal
CPU3: Core power limit normal
CPU14: Core power limit normal
CPU0: Core power limit normal
CPU2: Core power limit normal
CPU4: Core power limit normal
CPU12: Core power limit normal
CPU1: Core power limit normal
CPU13: Core power limit normal
CPU17: Core power limit normal
CPU5: Package power limit normal
CPU16: Package power limit normal
CPU3: Package power limit normal
CPU14: Package power limit normal
CPU0: Package power limit normal
CPU2: Package power limit normal
CPU4: Package power limit normal
CPU12: Package power limit normal
CPU1: Package power limit normal
CPU13: Package power limit normal
CPU17: Package power limit normal
CPU15: Package power limit notification (total events = 51516)
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU18: Core power limit normal
CPU21: Core power limit normal
CPU11: Core power limit normal
CPU23: Core power limit normal
CPU19: Core power limit normal
CPU6: Core power limit normal
CPU8: Core power limit normal
CPU7: Core power limit normal
CPU9: Core power limit normal
CPU20: Core power limit normal
CPU22: Package power limit normal
CPU18: Package power limit normal
CPU21: Package power limit normal
CPU11: Package power limit normal
CPU23: Package power limit normal
CPU19: Package power limit normal
CPU6: Package power limit normal
CPU8: Package power limit normal
CPU7: Package power limit normal
CPU9: Package power limit normal
CPU20: Package power limit normal
CPU10: Package power limit notification (total events = 55319)
CPU5: Core power limit normal
CPU16: Core power limit normal
CPU4: Core power limit normal
CPU2: Core power limit normal
CPU14: Core power limit normal
CPU15: Core power limit normal
CPU0: Core power limit normal
CPU3: Core power limit normal
CPU17: Core power limit normal
CPU1: Core power limit normal
CPU13: Core power limit normal
CPU12: Core power limit normal
CPU16: Package power limit normal
CPU4: Package power limit normal
CPU2: Package power limit normal
CPU14: Package power limit normal
CPU15: Package power limit normal
CPU0: Package power limit normal
CPU3: Package power limit normal
CPU17: Package power limit normal
CPU1: Package power limit normal
CPU13: Package power limit normal
CPU12: Package power limit normal
CPU5: Package power limit notification (total events = 51452)
CPU11: Core power limit normal
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU23: Core power limit normal
CPU18: Core power limit normal
CPU21: Core power limit normal
CPU6: Core power limit normal
CPU7: Core power limit normal
CPU19: Core power limit normal
CPU9: Core power limit normal
CPU22: Package power limit normal
CPU10: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU23: Package power limit normal
CPU18: Package power limit normal
CPU21: Package power limit normal
CPU6: Package power limit normal
CPU7: Package power limit normal
CPU19: Package power limit normal
CPU9: Package power limit normal
CPU11: Package power limit notification (total events = 55249)
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU17: Core power limit normal
CPU5: Core power limit normal
CPU3: Core power limit normal
CPU14: Core power limit normal
CPU2: Core power limit normal
CPU0: Core power limit normal
CPU1: Core power limit normal
CPU12: Core power limit normal
CPU15: Core power limit normal
CPU13: Core power limit normal
CPU16: Package power limit normal
CPU17: Package power limit normal
CPU5: Package power limit normal
CPU3: Package power limit normal
CPU14: Package power limit normal
CPU2: Package power limit normal
CPU0: Package power limit normal
CPU1: Package power limit normal
CPU12: Package power limit normal
CPU15: Package power limit normal
CPU13: Package power limit normal
CPU4: Package power limit notification (total events = 51532)
CPU7: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU11: Core power limit normal
CPU19: Core power limit normal
CPU21: Core power limit normal
CPU20: Core power limit normal
CPU22: Core power limit normal
CPU9: Core power limit normal
CPU10: Core power limit normal
CPU8: Core power limit normal
CPU23: Core power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU19: Package power limit normal
CPU21: Package power limit normal
CPU20: Package power limit normal
CPU22: Package power limit normal
CPU9: Package power limit normal
CPU10: Package power limit normal
CPU8: Package power limit normal
CPU23: Package power limit normal
CPU7: Package power limit notification (total events = 55644)
CPU11: Package power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU3: Core power limit normal
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU15: Core power limit normal
CPU2: Core power limit normal
CPU13: Core power limit normal
CPU1: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU14: Core power limit normal
CPU16: Package power limit normal
CPU3: Package power limit normal
CPU5: Package power limit normal
CPU17: Package power limit normal
CPU15: Package power limit normal
CPU2: Package power limit normal
CPU13: Package power limit normal
CPU1: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU14: Package power limit normal
CPU4: Package power limit notification (total events = 51543)
CPU11: Core power limit normal
CPU18: Core power limit normal
CPU8: Core power limit normal
CPU23: Core power limit normal
CPU20: Core power limit normal
CPU19: Core power limit normal
CPU9: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU7: Core power limit normal
CPU6: Core power limit normal
CPU21: Core power limit normal
CPU18: Package power limit normal
CPU8: Package power limit normal
CPU23: Package power limit normal
CPU20: Package power limit normal
CPU19: Package power limit normal
CPU9: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU7: Package power limit normal
CPU6: Package power limit normal
CPU21: Package power limit normal
CPU11: Package power limit notification (total events = 55270)
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU16: Core power limit normal
CPU3: Core power limit normal
CPU4: Core power limit normal
CPU15: Core power limit normal
CPU2: Core power limit normal
CPU0: Core power limit normal
CPU1: Core power limit normal
CPU12: Core power limit normal
CPU13: Core power limit normal
CPU14: Core power limit normal
CPU17: Package power limit normal
CPU16: Package power limit normal
CPU3: Package power limit normal
CPU4: Package power limit normal
CPU15: Package power limit normal
CPU2: Package power limit normal
CPU0: Package power limit normal
CPU1: Package power limit normal
CPU12: Package power limit normal
CPU13: Package power limit normal
CPU14: Package power limit normal
CPU5: Package power limit notification (total events = 51483)
CPU11: Core power limit normal
CPU23: Core power limit normal
CPU21: Core power limit normal
CPU9: Core power limit normal
CPU8: Core power limit normal
CPU18: Core power limit normal
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU6: Core power limit normal
CPU7: Core power limit normal
CPU19: Core power limit normal
CPU20: Core power limit normal
CPU23: Package power limit normal
CPU21: Package power limit normal
CPU9: Package power limit normal
CPU8: Package power limit normal
CPU18: Package power limit normal
CPU10: Package power limit normal
CPU22: Package power limit normal
CPU6: Package power limit normal
CPU7: Package power limit normal
CPU19: Package power limit normal
CPU20: Package power limit normal
CPU11: Package power limit notification (total events = 55281)
CPU17: Core power limit normal
CPU5: Core power limit normal
CPU15: Core power limit normal
CPU3: Core power limit normal
CPU4: Core power limit normal
CPU14: Core power limit normal
CPU12: Core power limit normal
CPU2: Core power limit normal
CPU0: Core power limit normal
CPU13: Core power limit normal
CPU16: Core power limit normal
CPU1: Core power limit normal
CPU5: Package power limit normal
CPU15: Package power limit normal
CPU3: Package power limit normal
CPU4: Package power limit normal
CPU14: Package power limit normal
CPU12: Package power limit normal
CPU2: Package power limit normal
CPU0: Package power limit normal
CPU13: Package power limit normal
CPU16: Package power limit normal
CPU1: Package power limit normal
CPU17: Package power limit notification (total events = 51497)
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU21: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU9: Core power limit normal
CPU6: Core power limit normal
CPU8: Core power limit normal
CPU19: Core power limit normal
CPU18: Core power limit normal
CPU7: Core power limit normal
CPU20: Core power limit normal
CPU10: Package power limit normal
CPU21: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU9: Package power limit normal
CPU6: Package power limit normal
CPU8: Package power limit normal
CPU19: Package power limit normal
CPU18: Package power limit normal
CPU7: Package power limit normal
CPU20: Package power limit normal
CPU22: Package power limit notification (total events = 55367)
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU15: Core power limit normal
CPU14: Core power limit normal
CPU3: Core power limit normal
CPU1: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU13: Core power limit normal
CPU2: Core power limit normal
CPU17: Package power limit normal
CPU4: Package power limit normal
CPU16: Package power limit normal
CPU15: Package power limit normal
CPU14: Package power limit normal
CPU3: Package power limit normal
CPU1: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU13: Package power limit normal
CPU2: Package power limit normal
CPU5: Package power limit notification (total events = 51506)
CPU22: Core power limit normal
CPU9: Core power limit normal
CPU10: Core power limit normal
CPU7: Core power limit normal
CPU19: Core power limit normal
CPU18: Core power limit normal
CPU8: Core power limit normal
CPU21: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU20: Core power limit normal
CPU6: Core power limit normal
CPU9: Package power limit normal
CPU10: Package power limit normal
CPU7: Package power limit normal
CPU19: Package power limit normal
CPU18: Package power limit normal
CPU8: Package power limit normal
CPU21: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU20: Package power limit normal
CPU6: Package power limit normal
CPU22: Package power limit notification (total events = 55381)
CPU4: Core power limit normal
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU3: Core power limit normal
CPU15: Core power limit normal
CPU2: Core power limit normal
CPU14: Core power limit normal
CPU13: Core power limit normal
CPU1: Core power limit normal
CPU0: Core power limit normal
CPU12: Core power limit normal
CPU16: Core power limit normal
CPU5: Package power limit normal
CPU17: Package power limit normal
CPU3: Package power limit normal
CPU15: Package power limit normal
CPU2: Package power limit normal
CPU14: Package power limit normal
CPU13: Package power limit normal
CPU1: Package power limit normal
CPU0: Package power limit normal
CPU12: Package power limit normal
CPU16: Package power limit normal
CPU4: Package power limit notification (total events = 51586)
CPU23: Core power limit normal
CPU22: Core power limit normal
CPU21: Core power limit normal
CPU10: Core power limit normal
CPU9: Core power limit normal
CPU19: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU11: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU7: Core power limit normal
CPU21: Package power limit normal
CPU10: Package power limit normal
CPU9: Package power limit normal
CPU19: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU11: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU7: Package power limit normal
CPU23: Package power limit notification (total events = 55292)
CPU22: Package power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU3: Core power limit normal
CPU17: Core power limit normal
CPU15: Core power limit normal
CPU5: Core power limit normal
CPU2: Core power limit normal
CPU14: Core power limit normal
CPU0: Core power limit normal
CPU13: Core power limit normal
CPU12: Core power limit normal
CPU1: Core power limit normal
CPU16: Package power limit normal
CPU3: Package power limit normal
CPU17: Package power limit normal
CPU15: Package power limit normal
CPU5: Package power limit normal
CPU2: Package power limit normal
CPU14: Package power limit normal
CPU0: Package power limit normal
CPU13: Package power limit normal
CPU12: Package power limit normal
CPU1: Package power limit normal
CPU4: Package power limit notification (total events = 51591)
CPU10: Core power limit normal
CPU22: Core power limit normal
CPU7: Core power limit normal
CPU21: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU19: Core power limit normal
CPU20: Core power limit normal
CPU18: Core power limit normal
CPU8: Core power limit normal
CPU6: Core power limit normal
CPU9: Core power limit normal
CPU7: Package power limit normal
CPU21: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU19: Package power limit normal
CPU20: Package power limit normal
CPU18: Package power limit normal
CPU8: Package power limit normal
CPU6: Package power limit normal
CPU9: Package power limit normal
CPU10: Package power limit notification (total events = 55396)
CPU22: Package power limit normal
CPU14: Core power limit normal
CPU15: Core power limit normal
CPU13: Core power limit normal
CPU5: Core power limit normal
CPU17: Core power limit normal
CPU16: Core power limit normal
CPU4: Core power limit normal
CPU2: Core power limit normal
CPU0: Core power limit normal
CPU12: Core power limit normal
CPU1: Core power limit normal
CPU3: Core power limit normal
CPU15: Package power limit normal
CPU13: Package power limit normal
CPU5: Package power limit normal
CPU17: Package power limit normal
CPU16: Package power limit normal
CPU4: Package power limit normal
CPU2: Package power limit normal
CPU0: Package power limit normal
CPU12: Package power limit normal
CPU1: Package power limit normal
CPU3: Package power limit normal
CPU20: Core power limit normal
CPU8: Core power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU9: Core power limit normal
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU7: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU19: Core power limit normal
CPU21: Core power limit normal
CPU20: Package power limit normal
CPU8: Package power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU9: Package power limit normal
CPU10: Package power limit normal
CPU7: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU19: Package power limit normal
CPU21: Package power limit normal
CPU14: Package power limit notification (total events = 51622)
CPU22: Package power limit normal
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU21: Core power limit normal
CPU6: Core power limit normal
CPU20: Core power limit normal
CPU18: Core power limit normal
CPU11: Core power limit normal
CPU23: Core power limit normal
CPU8: Core power limit normal
CPU7: Core power limit normal
CPU19: Core power limit normal
CPU9: Core power limit normal
CPU10: Package power limit normal
CPU4: Core power limit normal
CPU16: Core power limit normal
CPU1: Core power limit normal
CPU13: Core power limit normal
CPU14: Core power limit normal
CPU15: Core power limit normal
CPU3: Core power limit normal
CPU17: Core power limit normal
CPU5: Core power limit normal
CPU0: Core power limit normal
CPU12: Core power limit normal
CPU2: Core power limit normal
CPU21: Package power limit normal
CPU6: Package power limit normal
CPU20: Package power limit normal
CPU18: Package power limit normal
CPU11: Package power limit normal
CPU23: Package power limit normal
CPU8: Package power limit normal
CPU7: Package power limit normal
CPU19: Package power limit normal
CPU9: Package power limit normal
CPU4: Package power limit normal
CPU16: Package power limit normal
CPU1: Package power limit normal
CPU13: Package power limit normal
CPU14: Package power limit normal
CPU15: Package power limit normal
CPU3: Package power limit normal
CPU17: Package power limit normal
CPU5: Package power limit normal
CPU0: Package power limit normal
CPU12: Package power limit normal
CPU2: Package power limit normal
CPU22: Package power limit normal
CPU3: Core power limit normal
CPU15: Core power limit normal
CPU5: Core power limit normal
CPU16: Core power limit normal
CPU17: Core power limit normal
CPU4: Core power limit normal
CPU2: Core power limit normal
CPU14: Core power limit normal
CPU13: Core power limit normal
CPU1: Core power limit normal
CPU12: Core power limit normal
CPU0: Core power limit normal
CPU15: Package power limit normal
CPU5: Package power limit normal
CPU16: Package power limit normal
CPU17: Package power limit normal
CPU4: Package power limit normal
CPU2: Package power limit normal
CPU14: Package power limit normal
CPU13: Package power limit normal
CPU1: Package power limit normal
CPU12: Package power limit normal
CPU0: Package power limit normal
CPU23: Core power limit normal
CPU11: Core power limit normal
CPU9: Core power limit normal
CPU21: Core power limit normal
CPU8: Core power limit normal
CPU20: Core power limit normal
CPU22: Core power limit normal
CPU10: Core power limit normal
CPU7: Core power limit normal
CPU6: Core power limit normal
CPU18: Core power limit normal
CPU19: Core power limit normal
CPU23: Package power limit normal
CPU11: Package power limit normal
CPU9: Package power limit normal
CPU21: Package power limit normal
CPU8: Package power limit normal
CPU20: Package power limit normal
CPU10: Package power limit normal
CPU7: Package power limit normal
CPU6: Package power limit normal
CPU18: Package power limit normal
CPU19: Package power limit normal
CPU3: Package power limit notification (total events = 51616)
CPU22: Package power limit normal